-- Logs begin at Sun 2022-07-31 00:10:36 UTC, end at Sun 2022-07-31 01:28:22 UTC. -- Jul 31 00:58:45.916584 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 31 00:58:45.923777 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 00:58:45 2022] *** Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: nodename: dv-osbrick-master-4-iscsi Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: machine: x86_64 Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: clock source: unix Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: pcre jit disabled Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: detected number of CPU cores: 4 Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: current working directory: / Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: detected binary path: /usr/bin/uwsgi-core Jul 31 00:58:45.926854 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: your processes number limit is 47680 Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: your memory page size is 4096 bytes Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: detected max file descriptor number: 2048 Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: lock engine: pthread robust mutexes Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: thunder lock: enabled Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 31 00:58:45.927540 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 00:58:45.966490 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: Python main interpreter initialized at 0x5576583709c0 Jul 31 00:58:45.966490 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: python threads support enabled Jul 31 00:58:45.966490 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: your server socket listen backlog is limited to 100 connections Jul 31 00:58:45.966490 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: your mercy for graceful operations on workers is 90 seconds Jul 31 00:58:45.966857 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 00:58:45.966931 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: *** Operational MODE: preforking *** Jul 31 00:58:45.967181 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: *** uWSGI is running in multiple interpreter mode *** Jul 31 00:58:45.967181 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: spawned uWSGI master process (pid: 80321) Jul 31 00:58:45.967382 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 31 00:58:45.968563 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: spawned uWSGI worker 1 (pid: 80326, cores: 1) Jul 31 00:58:45.968563 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: spawned uWSGI worker 2 (pid: 80327, cores: 1) Jul 31 00:58:45.968563 dv-osbrick-master-4-iscsi devstack@keystone.service[80321]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 00:58:51.504703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:58:51.504703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes Jul 31 00:58:51.505556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:58:51.505556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 31 00:58:51.506020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:58:51.506020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes Jul 31 00:58:51.506145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:58:51.506145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 31 00:58:51.554891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 00:58:51.555081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 00:58:51.555255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] command line args: [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 00:58:51.555444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 00:58:51.555534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 00:58:51.555649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 00:58:51.555742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ================================================================================ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 00:58:51.555836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] command line args: [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 00:58:51.555920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.556108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 00:58:51.556194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_dir = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.556306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ================================================================================ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 00:58:51.556391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.556522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_source = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.556608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.556687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] debug = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] config_dir = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] config_source = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] debug = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.557895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558155 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558254 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.558917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_config_append = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_dir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559390 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_config_append = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_dir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560643 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560868 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.560995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.561961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.562876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] publish_errors = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] publish_errors = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.563904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] standard_threads = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.564975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] standard_threads = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565334 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_journal = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_json = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_stderr = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_syslog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] use_journal = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.565945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.566011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] use_json = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.566087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.566162 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] use_stderr = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.566227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.566286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] use_syslog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.566486 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:58:51.566594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.566672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.566756 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.566912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.567967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568120 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.568961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569097 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.569909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.570879 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.571870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.572994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.573940 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.574950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.575835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.576874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577006 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.577902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.578958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.579999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.580962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581716 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.581981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.582884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583508 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.583889 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.584913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585555 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.585979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586239 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586623 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.586979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587349 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587726 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.587974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.588896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589157 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.589958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.590093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.590220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.590353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.590481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.590880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.591912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.external = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.592976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.password = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.external = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.593886 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.token = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.594011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.594134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.594757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.594873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.password = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.token = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.595923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.596879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597638 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.597924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.598965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.599992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.600811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.601911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.602936 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603458 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.603973 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.604968 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605597 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.605970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.606887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607511 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.607892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608422 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.608969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.610610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.610746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.610874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611265 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611648 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.611896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.612975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.613969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.614964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.615976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616523 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.616927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.617959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.618852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.619914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.620907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621398 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.621987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.622911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623265 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.623966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.624941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625512 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.625976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.626919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627408 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.627922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628561 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.628940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.629916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630265 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] role.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630618 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630742 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] role.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.630974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.631910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632548 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.632909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.633967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.634971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635597 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.635974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.636875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.637995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638340 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638696 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.638926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639664 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.639903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.640904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.641018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.641673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.641791 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.641916 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642157 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642515 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.642987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.643904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.644934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645310 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.645954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646200 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646563 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.646699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:58:51.647640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 00:58:51.669764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.669993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.670223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.671070 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.671305 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.671536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.678554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.679894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.708919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.709141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.710900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.711140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.761444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.761866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.812383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.812688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.813619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.813855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.878408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.878629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.878852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879143 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879354 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.879987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.880214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.902756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.902984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.903948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.904079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.904159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.904314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.915429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.915816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.929338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.929568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.929733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.929844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.929975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930511 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.930845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.931059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 00:58:51.948498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.948714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 00:58:51.949050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.949173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.949252 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 00:58:51.949404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 00:58:51.949492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.949758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.949851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.950011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.950112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 00:58:51.950266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.950352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.950594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.950857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.951117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.959928 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.960204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.960549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.960816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.961625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.962048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.962420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.962818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.967651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:51.971006 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:51.972487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:51.972777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.973055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.973336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.973613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.973870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.974137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.974405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.974674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.974948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.975212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.975908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:51.976195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.976509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.976795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.977082 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.977346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.977619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.977897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.978173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.978451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.979289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.998467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:51.999943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.000215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.002833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.004354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.004639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.005391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.005670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.005949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.009288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.009572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.009864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.012637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.012871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.016571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.016861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.016982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.017266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.017555 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.017834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.018108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.018390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.018657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.018930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.021399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.021691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.021988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.022273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.022551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.022843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.023113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.023392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.035295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.035577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.039514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.039870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.040161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.042641 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.042934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.044109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.047326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.047954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.048122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.051072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.052704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.054242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.054539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.054833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.055129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.055405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.055690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.055772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.059219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.059524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.059809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.060104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.060411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.060702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.071878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.072449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.072714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.076800 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.077085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.077353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.077618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.079724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.081289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.081564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.084376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.084559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.084653 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.084941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.085220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.085506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.086129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.086406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.089272 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.089558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.089858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.090150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.090440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.097565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.097847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.098125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.098398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.098942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.099223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.102503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.102784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.103086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.103344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.103628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.103906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.104195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.115262 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.118234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.120817 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.121230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.123372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.123833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.125354 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.125660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.125943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.126461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.129094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.130628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.133145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.133145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.133405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.133962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.136899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.137186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.137470 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.137747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.137831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.139460 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.142539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.142838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.143126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.143401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.145772 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.146059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.146338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.151471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.151766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.152051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.153159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.153436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.153714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.153987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.154268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.154545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.154812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.155082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.155450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.155734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.156016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.156297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.156575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.157348 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.159442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 00:58:52.159727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.160017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.160315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.160602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.160886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.161173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.161450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.161823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.162106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.162396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.162663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.162938 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.163199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 00:58:52.191272 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576583709c0 pid: 80326 (default app) Jul 31 00:58:52.194676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2add2-1d59-4907-a65c-904db96364ca None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:58:52.194965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2add2-1d59-4907-a65c-904db96364ca None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:58:52.195241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2add2-1d59-4907-a65c-904db96364ca None None] PATH_INFO: `/v3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:58:52.197311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576583709c0 pid: 80327 (default app) Jul 31 00:58:52.199512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Sun Jul 31 00:58:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:58:59.855707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:58:59.856317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:58:59.856317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:58:59.861419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:58:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:58:59.866944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:58:59.867415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:58:59.867507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:58:59.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: INFO dbcounter [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] Registered counter for database keystone Jul 31 00:58:59.960212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:58:59.966490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writer thread running {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:59:00.153570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80326) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 00:59:00.153997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80326) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 00:59:00.210135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:00.211737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:00.345360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:58:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 00:59:00.493745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:00.563079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: INFO dbcounter [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] Registered counter for database keystone Jul 31 00:59:00.583830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG oslo_db.sqlalchemy.engines [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:59:00.589994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writer thread running {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:59:00.707640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9012fd-58d6-4b88-bd03-7951370ff614 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:00.711966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:00.712640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:00.712922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:00.713197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:00.721276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:00.773059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 00:59:00.773333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60dc33-aa6c-48e4-b1b3-00ab472b364e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:00.783040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Sun Jul 31 00:59:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 00:59:00.789119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:00.803857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e85efd-c815-41b7-a9c6-5bff2c2c96dd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:00.808644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:00.809773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:00.810062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:00.810342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] PATH_INFO: `/v3/projects/75a7020f93b24515b5df25cc753d8bc8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:00.811840 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] RBAC: Authorizing `identity:get_project(project_id=75a7020f93b24515b5df25cc753d8bc8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:00.867295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 00:59:00.867935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224e0a0-1732-44d0-9d85-2a12edcb46dc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:00.872453 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Sun Jul 31 00:59:00 2022] GET /identity/v3/projects/75a7020f93b24515b5df25cc753d8bc8 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:02.889190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25fd6-984e-4548-8366-c1d9b189bdeb None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:02.889713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25fd6-984e-4548-8366-c1d9b189bdeb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:02.889819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a25fd6-984e-4548-8366-c1d9b189bdeb None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:02.894484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:02.900242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:02.900689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:02.900830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:02.924189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:02.925786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:02.934082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 00:59:02.956344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25fd6-984e-4548-8366-c1d9b189bdeb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:02.968449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a25fd6-984e-4548-8366-c1d9b189bdeb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:02.973288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:02.973897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:02.974184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:02.974465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:02.982174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:02.983956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deec0a2-ab1e-432f-b8f1-60204e984fca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:02.992714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Sun Jul 31 00:59:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 00:59:02.998277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:03.007384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6da559-042d-43cb-9fd1-6d52178bb9bc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:03.011760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:03.012445 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:03.012737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:03.013023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:03.014397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:03.016782 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315baf9-d17a-484d-a939-3257344397cf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:03.018344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Sun Jul 31 00:59:02 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:05.076944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5745-88c9-41f9-ae17-a3f92601ea3c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.077514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5745-88c9-41f9-ae17-a3f92601ea3c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.077514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5745-88c9-41f9-ae17-a3f92601ea3c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.078880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:05.084336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.084758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.084893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.104384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:05.105591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:05.114273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa970e-2f30-4595-bf89-47e1d8c70e98 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.114565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa970e-2f30-4595-bf89-47e1d8c70e98 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.114848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa970e-2f30-4595-bf89-47e1d8c70e98 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.116185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:05.121660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773338-7991-4140-ba47-b1523a57b786 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.121952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773338-7991-4140-ba47-b1523a57b786 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.122235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773338-7991-4140-ba47-b1523a57b786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.165242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-29773338-7991-4140-ba47-b1523a57b786 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80327) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 00:59:05.165613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-29773338-7991-4140-ba47-b1523a57b786 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80327) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 00:59:05.189614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:05.211825 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.211975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-29773338-7991-4140-ba47-b1523a57b786 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:05.213540 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29773338-7991-4140-ba47-b1523a57b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:05.235856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.313842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:05.318999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef8b8-ea14-4f62-b019-ea4898e9aa2e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.335878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29773338-7991-4140-ba47-b1523a57b786 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.352231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.352909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.353196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.353476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.369210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:05.379196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:05.380096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:05.380951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:05.386201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.436468 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29773338-7991-4140-ba47-b1523a57b786 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.439339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.469202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.474229 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.474514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.474794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.488152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7275-0251-446e-8077-eba7debcb7c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.521944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.522576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.522863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.523145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.523879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:05.524196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.525630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.537790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:05.543415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.543713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.545291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.646433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:05.652395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.655559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.751814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4d81a-76d6-4680-9249-7606c963f3fa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.758061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c47ba-6eb7-45e4-b999-5beb810fc9f7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.786238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.786896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.787183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.787472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.788677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.790143 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.791919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:05.792064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.793040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.793332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.793613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.797161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.812234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.813210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.814329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 00:59:05.833304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:05.834334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:05.835195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 00:59:05.835195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 00:59:05.835195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 00:59:05.835195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:05.835195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:05.840575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.896586 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:05.904386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba02a7-8554-4625-a543-15517ec8e833 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.939189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.939847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.940154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.940461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.940899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0550-3aae-42c2-b46b-8d8d00946e75 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:05.941687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.943144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.944765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:05.950421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:05.974728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:05.975356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:05.975638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:05.975921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:05.976656 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:05.976963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:05.978359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfeb7e-d18c-44d0-8707-bb088a9439df None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:05.998079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:06.040657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:06.063258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927195-e51d-47be-acd7-8af78ba09c4c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:06.098591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:06.099284 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:06.099515 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:06.099797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:06.100647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.domain.id=default, user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:06.100964 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:06.102465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d18684-b0e3-4b72-bf70-d8f98f11a803 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:06.120315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Sun Jul 31 00:59:05 2022] GET /identity/v3/role_assignments?user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18&scope.domain.id=default&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:08.504909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1dec0-b1aa-43fb-b3f6-e2516edee055 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:08.505899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1dec0-b1aa-43fb-b3f6-e2516edee055 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:08.506399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1dec0-b1aa-43fb-b3f6-e2516edee055 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:08.508202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:08.524948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f76-30c2-4ca0-975a-748ee38a49c0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:08.525440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f76-30c2-4ca0-975a-748ee38a49c0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:08.525518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192f76-30c2-4ca0-975a-748ee38a49c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:08.549493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-39192f76-30c2-4ca0-975a-748ee38a49c0 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:08.550707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-39192f76-30c2-4ca0-975a-748ee38a49c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:08.638870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:08.673973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1dec0-b1aa-43fb-b3f6-e2516edee055 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:08.814077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adabd-4e10-4a60-9ce6-a8180be14064 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:08.814363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adabd-4e10-4a60-9ce6-a8180be14064 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:08.814556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adabd-4e10-4a60-9ce6-a8180be14064 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:08.815043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1dec0-b1aa-43fb-b3f6-e2516edee055 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:08.816054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:08.828611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1967dc-7ef2-4321-a267-23e3f8ab6afd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:08.828920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1967dc-7ef2-4321-a267-23e3f8ab6afd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:08.829171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1967dc-7ef2-4321-a267-23e3f8ab6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:08.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:08.877279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9d1967dc-7ef2-4321-a267-23e3f8ab6afd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:08.878223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:08.878507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d1967dc-7ef2-4321-a267-23e3f8ab6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:08.879341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:08.879825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:08.880366 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:08.895906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:08.897461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 00:59:08.939206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:08.940058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:08.940888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 00:59:08.940888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 00:59:08.940888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 00:59:08.940888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:08.944947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 12/25] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:08.951133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.045956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 14/26] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 31 00:59:09.047708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db616-0a77-41c8-bef0-c9d076dfc48d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.048076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db616-0a77-41c8-bef0-c9d076dfc48d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.048385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db616-0a77-41c8-bef0-c9d076dfc48d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.050066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 15/27] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:09.055601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9263-d4e8-44a3-a111-57a28d8fdafd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.055993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9263-d4e8-44a3-a111-57a28d8fdafd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.056145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9263-d4e8-44a3-a111-57a28d8fdafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.082755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:09.088956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a2de9263-d4e8-44a3-a111-57a28d8fdafd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:09.091183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a2de9263-d4e8-44a3-a111-57a28d8fdafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:09.172321 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 16/28] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:09.173568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418800-77ab-4ba7-8a52-37b241dea11c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.173968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418800-77ab-4ba7-8a52-37b241dea11c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.174255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418800-77ab-4ba7-8a52-37b241dea11c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.175809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 17/29] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:09.176452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418800-77ab-4ba7-8a52-37b241dea11c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.212210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cfcf1-7bf0-44d8-997d-56c25f1f83cb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.249854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.250658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.250951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.251228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.251928 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:09.252235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:09.253849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810747f-8d34-4b3f-9c7e-e4b28a58d050 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:09.266601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 13/30] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 00:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:09.267949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.268242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.268543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.288033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418800-77ab-4ba7-8a52-37b241dea11c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:09.289998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:09.316067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:09.326889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.327556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.327974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.328322 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.330437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:09.340758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:09.346859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:09.347712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:09.349443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 18/31] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:09.353407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.369863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 14/32] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:09.370794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.474738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6a62-2144-40d3-a6be-476d02a9e9b9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.484066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237b78-7c86-4190-ac75-94e972c44393 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.512046 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.512714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.513002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.513281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.514013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:09.515423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:09.524593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.525280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.525691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.526113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.527595 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:09.529271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:09.641618 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 19/33] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:09.643273 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.689402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 15/34] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:09.690791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.707954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:09.727968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:09.846194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7eacd-ca76-4f2a-9df1-743736404c99 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.888228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ab4c-99a1-4293-920f-642a6b03460f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:09.910839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.911421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.911705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.911985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.912863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:09.913245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:09.914814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30fe1-4b3c-4b21-8e30-d58953489105 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:09.927573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 20/35] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:09.928827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1d35-572b-4c9f-9715-42ba716391cb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.929123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1d35-572b-4c9f-9715-42ba716391cb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.929408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1d35-572b-4c9f-9715-42ba716391cb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.930660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 21/36] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:09.936415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b1d35-572b-4c9f-9715-42ba716391cb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:09.942101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:09.942822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.943138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.943407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:09.944211 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:09.946009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78eb8e-6c22-4c13-a1d8-a3050649ac19 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:09.971457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 16/37] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/roles => generated 219 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:09.978288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454d0e-c7df-47a3-9ae7-dcbdf4317a2d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:09.978607 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454d0e-c7df-47a3-9ae7-dcbdf4317a2d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:09.978859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454d0e-c7df-47a3-9ae7-dcbdf4317a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.005953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eb454d0e-c7df-47a3-9ae7-dcbdf4317a2d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:10.007927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eb454d0e-c7df-47a3-9ae7-dcbdf4317a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:10.088182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b1d35-572b-4c9f-9715-42ba716391cb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.098888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:10.104641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 17/38] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:10.106156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abead-0d8d-4323-b314-f8f8d5ceb000 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.107260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abead-0d8d-4323-b314-f8f8d5ceb000 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.107458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269abead-0d8d-4323-b314-f8f8d5ceb000 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.112476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 18/39] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:10.112986 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:10.115323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.115453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.115790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.136633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.138417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.138417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.138615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.139844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.140558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:10.141995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.142329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:10.148414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 22/40] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:09 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:10.148414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:10.228074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 19/41] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:10.228971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:10.267362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5001-788e-41b4-bc65-5ae62edd9326 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.302133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.302945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.303345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.303722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.304588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.306111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 23/42] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Jul 31 00:59:10 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:10.323621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:10.349155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2037f7c-70c2-45c0-9d63-c07985b6a09d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.391152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:10.399359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:10.400144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.400899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.401433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.401615 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.403213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.404854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.411854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 20/43] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:10.413088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:10.508895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8f392-1c88-4ed0-87e8-8c965bb00527 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.545535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a110ed-7ffd-4950-8726-9b4000e4552f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.551883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.552573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.552866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.553151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.554466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.555966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.557918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 24/44] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:10.564191 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:10.590927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.591620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.591915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.592205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] PATH_INFO: `/v3/domains/default/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.594547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.596053 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224872c9-9719-42f8-8d2a-29f83ef4a68c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.616702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 21/45] 10.222.0.40 () {58 vars in 1361 bytes} [Sun Jul 31 00:59:10 2022] PUT /identity/v3/domains/default/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:10.678732 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf47b8-da9d-4d91-ad94-9799e20443d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:10.693784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:10.717321 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:10.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:10.718267 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:10.718760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:10.719673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:10.721275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4ac7-f0ca-47ed-9701-256286455af9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:10.756056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 00:59:10 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 00:59:12.628595 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930a52-5401-4913-809b-b9f89bf83bdf None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:12.629121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930a52-5401-4913-809b-b9f89bf83bdf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:12.629209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05930a52-5401-4913-809b-b9f89bf83bdf None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:12.630534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:12.635699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58b32-b918-42c6-a4b1-c231db8c243b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:12.636085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58b32-b918-42c6-a4b1-c231db8c243b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:12.636411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58b32-b918-42c6-a4b1-c231db8c243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:12.654726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c1e58b32-b918-42c6-a4b1-c231db8c243b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:12.656295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c1e58b32-b918-42c6-a4b1-c231db8c243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:12.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:12.746216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05930a52-5401-4913-809b-b9f89bf83bdf None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:12.788959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503680-daee-49dd-a26a-19b2186e339f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:12.789247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503680-daee-49dd-a26a-19b2186e339f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:12.789540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503680-daee-49dd-a26a-19b2186e339f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:12.791023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 27/49] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:12.795640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:12.795926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:12.796202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:12.806314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:12.816526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:12.817731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:12.849566 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05930a52-5401-4913-809b-b9f89bf83bdf None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:12.883461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 28/50] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:12.884345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:12.884996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:12.885276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:12.885550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:12.904317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:12.905920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:12.911205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:12.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:12.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:12.916399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 23/51] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:12.918105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:12.930903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:13.006562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679fe5-4048-4db0-9ca5-cb3b102dff7a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.019310 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54f0cc-b0e8-4dbd-b14d-c60ac733a92d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.036745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:13.039674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.040367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.040661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.040943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.043602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.045251 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 29/52] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:13.051446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:13.054607 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.055266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.055562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.055843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.056610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:13.057181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.058602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.071674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 24/53] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:13.077235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:13.145195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:13.154251 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6bab8-4296-452e-b35e-36e71f74a7e7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.176530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c122be-2ea8-43fd-ab4c-409e249772da None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.188559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.189268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.189562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.189842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.190534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.191998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.211145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.211841 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.212097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.212446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.213635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.215074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.216903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:13 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:13.222639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:13.223785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 30/55] 10.222.0.40 () {60 vars in 1140 bytes} [Sun Jul 31 00:59:13 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 00:59:13.277611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:13.331939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f692b-6fff-4369-8320-a9ea499c6d7a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.367388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.368046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.368366 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.368648 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.369816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.371285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6067c-8091-417c-973e-c97e6be3ad49 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.372920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 26/56] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:13.379326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:13.486271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892c83-df4e-408b-999c-38e4d2b5f5c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:13.519568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:13.520198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:13.520516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:13.520799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:13.521606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.domain.id=default, user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:13.521924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:13.523378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8554f-c539-40af-8dce-25c2be13cb0d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:13.529147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 31/57] 10.222.0.40 () {56 vars in 1322 bytes} [Sun Jul 31 00:59:13 2022] GET /identity/v3/role_assignments?user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18&scope.domain.id=default&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:15.218825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5ed9c-a50d-4082-8e6a-059f44a4fd37 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:15.219318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5ed9c-a50d-4082-8e6a-059f44a4fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:15.219405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5ed9c-a50d-4082-8e6a-059f44a4fd37 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:15.220780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:15.225824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:15.226216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:15.226386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:15.244809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:15.245994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:15.247927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:15.312759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:15.336525 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5ed9c-a50d-4082-8e6a-059f44a4fd37 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:15.434653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5ed9c-a50d-4082-8e6a-059f44a4fd37 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:15.451023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:15.468639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:15.469657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:15.470167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:15.470656 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:15.472636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:15.474834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004bf77-5e3d-4ad4-853c-39ec7b94a02f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:15.477420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:15.482980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:15.580570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c891567-716d-4d75-b99e-f35cc6923706 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:15.613297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:15.613918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:15.614206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:15.614490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:15.615190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:15.616700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb7208-34ef-42c2-8ecb-5e75f23b2752 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:15.631084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:15.645256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:15 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:18.657732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b2b4e-4e2e-43cc-9736-1980dcab97dc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.658773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b2b4e-4e2e-43cc-9736-1980dcab97dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.659256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b2b4e-4e2e-43cc-9736-1980dcab97dc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.660834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:18.666559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.667421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.667912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.697014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:18.698530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:18.781282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7fc2-b903-426d-90d9-c940b978f41f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.781901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7fc2-b903-426d-90d9-c940b978f41f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.782394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7fc2-b903-426d-90d9-c940b978f41f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.783937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 30/63] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:18.789991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248266d8-7295-4287-8ad2-d44416e4bc1d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.790541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248266d8-7295-4287-8ad2-d44416e4bc1d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.791032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248266d8-7295-4287-8ad2-d44416e4bc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.793204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 34/64] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:18.817645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:18.829360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-248266d8-7295-4287-8ad2-d44416e4bc1d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:18.830930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-248266d8-7295-4287-8ad2-d44416e4bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:18.941819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958929c-3f78-4604-98d8-be526c3921f7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:18.947205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 31/65] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:18.948764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4319-4b8d-4b9d-a781-649f08631194 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4319-4b8d-4b9d-a781-649f08631194 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.949596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba4319-4b8d-4b9d-a781-649f08631194 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.951272 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 32/66] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:18.956741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:18.957237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:18.957650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:18.977547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:18.979455 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:18.990619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.005568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.006565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.007068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.018883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:19.024278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:19.025098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:19.025965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:19.028279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 35/67] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:19.029389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.068741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 33/68] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:19.069989 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.136825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.170573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f16f2e-0592-4f93-b006-9bb9ffce8dd4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.210654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45112a41-3495-4273-9baf-d1efeb641173 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.213009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.214605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.214904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.215190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.229332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:19.236325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:19.237246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:19.237984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 36/69] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:19.238612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.258923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.259949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.260491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.261003 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.261935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:19.262443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.264049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.273637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 34/70] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.275056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.299521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.363772 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161974f-f67b-4fe4-8601-e1f6c9ad56f6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.402035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.403100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.403587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.404119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.415065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535e94a-6b69-450b-b0f4-089764aeaf61 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.416725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:19.422626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:19.423493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:19.424243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:19.424837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.432277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 37/71] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:19.432277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.458329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.458965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.459256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.459615 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.460281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:19.460600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.462245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1f5c6-ed04-43d7-8c31-59a2b02fcebf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 35/72] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6c7f-e906-46db-a5df-f430c18cbda2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6c7f-e906-46db-a5df-f430c18cbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6c7f-e906-46db-a5df-f430c18cbda2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 36/73] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:19.474599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6c7f-e906-46db-a5df-f430c18cbda2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.550261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7c72-55cf-4b4a-96c4-e251ed8a7570 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.553165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.593135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.593795 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.594087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.594353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.598431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6c7f-e906-46db-a5df-f430c18cbda2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.613396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.614931 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.616847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 38/74] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.617597 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.645158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.645794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.646079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.646360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.647097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:19.647407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.649129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc629b1-3b8f-4f23-9af7-8b257af88cb7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.658440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.659715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.660010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.660311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.679374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:19.681264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:19.714160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.732869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561336f7-7db5-4304-9eb2-5d50f56ab7cd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.767918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 38/76] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:19.767918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.775379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.776035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.776367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.776668 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.779283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.781542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 39/77] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.785119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.816698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.879139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d24d3-d93e-4a1c-a360-fda43fa67b50 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.887619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211209-f98c-44f9-a9a4-802bd87f28c8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:19.916009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.916669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.916959 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.917237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.923825 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:19.924512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:19.924801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:19.925082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:19.926258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.927723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:19.929383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 40/78] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:19.930158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:19.949611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:19.991839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:19.993295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.032718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.036939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b7a5-f528-40eb-8a55-834f31270e1b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.071452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.072085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.072404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.072686 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.097192 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 39/79] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:20.098040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.144669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.146158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89632524-26e4-4d92-be81-b1049bffaf85 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.161174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.203453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be600a-67ff-4183-b694-f21651fc4629 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.237141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.237799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.238094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.238382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.240526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.245553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:20.246874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcc1bf-d26f-40b0-8e9c-af396cd2df8b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.247413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcc1bf-d26f-40b0-8e9c-af396cd2df8b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.247694 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcc1bf-d26f-40b0-8e9c-af396cd2df8b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.249163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 42/81] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:20.250710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcc1bf-d26f-40b0-8e9c-af396cd2df8b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.252992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:20.258095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:20.258936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 40/82] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:20.264567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.354277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcc1bf-d26f-40b0-8e9c-af396cd2df8b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.361312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c8dc-6b1d-4b7f-a120-bb30d2945f50 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.381772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.388867 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.389499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.389786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.390088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.396505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.397154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.397439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.397718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.398886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.400380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745836b-4da4-498f-be5f-8d9875bf104f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.402045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 41/83] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.403328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.403594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.403873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.420880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:20.422592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:20.455831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.460126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.461647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.488933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 42/84] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:20.489785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.560733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 43/85] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:20.561513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.590377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebefb79-dc3f-40c5-842a-22349f35bd81 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.608456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.626059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.626713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.627002 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.627283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.628508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.629965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.631645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 43/86] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.632451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.663562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.667773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9833c8-caf8-483e-a6a9-d587b5276d7e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.702930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.703561 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.703847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.704128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.704884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:20.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.706577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.714606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 44/87] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.715403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.732132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d0f1-e839-4dba-bb68-281f0b17aac5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.765019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.766165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.766472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.766731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.767531 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:20.767840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.769343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.776737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 44/88] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=65640d9c917344788480a7d50c0694c0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.777526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.837128 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.837324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf4189-26f2-467e-b448-86e55c5ecc61 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.874449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.875997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.876290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.877499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.878960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.880858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 45/89] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.881423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.912467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa6a-5e0a-4eef-92e0-c37ea5d8b97c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:20.914095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:20.962034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:20.962716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:20.963060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:20.963301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:20.965289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:20.966746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:20.968606 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 45/90] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:20.969205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:20.997106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa8fb-790e-4d73-8fdf-46e8a91a7cf1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.036750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.037386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.037671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.037949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.038776 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:21.039129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.040765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.047685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 46/91] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:21.048517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:21.103888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f197-1b0e-4044-abac-127b62262a31 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.133563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:21.158534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.159203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.159487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.159785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.161775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.163632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.166634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 46/92] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:20 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:21.167753 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:21.176723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:21.194392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf883d-b02a-4f39-afce-559665423268 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.241744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.242382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.242666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.242943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.243639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.245258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.268153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 47/93] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:21 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:21.269375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:21.287484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a21d-47f8-40e5-845b-ff9395974085 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.334765 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.335417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.335941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.336228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.337063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:21.337376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.339766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.348064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 47/94] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:21 2022] GET /identity/v3/role_assignments?user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:21.391889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e0df-2bcb-42a7-b501-39073f39cb3c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.441525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.442352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.442738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.443116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.475208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:21.540998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.543426 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.652987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 48/95] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:21.658501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:21.717755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:21.778440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f270fe-4326-4a9a-8ed7-d1fd2b9242dc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:21.814986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:21.815646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:21.815931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:21.816209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] PATH_INFO: `/v3/projects/ef52cca5dda7435b87dffb26b76823ed` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:21.817396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] RBAC: Authorizing `identity:get_project(project_id=ef52cca5dda7435b87dffb26b76823ed)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:21.818864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328f97-73b7-42a5-bd66-30b574caa671 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:21.820561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 48/96] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:21 2022] GET /identity/v3/projects/ef52cca5dda7435b87dffb26b76823ed => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:21.826416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:21.892605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:21.963722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611609-59f9-44fc-bde9-76ba0b9667e5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:22.009913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:22.010557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:22.010838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:22.011110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:22.011917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=ef52cca5dda7435b87dffb26b76823ed, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:22.012229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:22.013720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2909ccd-8298-480f-af8e-9ce73acea6c6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:22.021268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 49/97] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:21 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=ef52cca5dda7435b87dffb26b76823ed&role.id=65640d9c917344788480a7d50c0694c0 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:23.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896f63e-d178-4c25-9674-5d8ff40d2311 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.279592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896f63e-d178-4c25-9674-5d8ff40d2311 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.279665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896f63e-d178-4c25-9674-5d8ff40d2311 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.281384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 49/98] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:23.286428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb959f2-37d1-473b-b6a4-bcecb5f03af6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.286827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb959f2-37d1-473b-b6a4-bcecb5f03af6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.287010 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb959f2-37d1-473b-b6a4-bcecb5f03af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.309251 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7cb959f2-37d1-473b-b6a4-bcecb5f03af6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:23.310448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7cb959f2-37d1-473b-b6a4-bcecb5f03af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:23.388363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:23.414846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896f63e-d178-4c25-9674-5d8ff40d2311 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:23.554818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896f63e-d178-4c25-9674-5d8ff40d2311 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:23.584787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:23.594836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175690f3-d657-426f-b639-c7c520a178bd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.595133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175690f3-d657-426f-b639-c7c520a178bd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.595402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175690f3-d657-426f-b639-c7c520a178bd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.596878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 51/100] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:23.608164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.608469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.608785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.626539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:23.627165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.627454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.627739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.639592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:23.641363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:23.659402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:23.664548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:23.665393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:23.666119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 50/101] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:23.673198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:23.724905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:23.794667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 52/102] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:23.826279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6278-53ea-4fdc-976d-e8772a392518 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:23.828745 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:23.871905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:23.872570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:23.872857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:23.873131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:23.873863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:23.874174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:23.875612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:23.889163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 51/103] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:23.895220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:23.940883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:24.004622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477aec4-345b-453d-81f4-87b1a08d03db None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.041006 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.041671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.041967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.042250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.043488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:24.044993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:24.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 52/104] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:23 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:24.052591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.134016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987afcc-d566-414e-b094-dbc8a5920e6f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.168610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68b58a-beaf-40c6-baca-eb1102479681 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.182425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:24.225012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.225700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.225993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.226274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.226894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.227794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.228308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.228824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.230304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:24.232059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:24.234877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 53/105] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:24 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:24.241091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.249358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:24.255009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:24.255848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:24.256615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 53/106] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:24.265350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.302167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:24.381612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4700be-0fa6-40b0-b4ff-207bb923253f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.433684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.434614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.435044 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.435454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.436602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:24.437105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:24.439386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf6ac7-1de5-4660-806d-f0d78ae11737 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:24.447031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1190-5b95-4fb1-9745-5a5ba04e160e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.466502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 54/107] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:24.467856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac896-a70a-441e-b1ea-95050258e374 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.468699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac896-a70a-441e-b1ea-95050258e374 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.468982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac896-a70a-441e-b1ea-95050258e374 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.470219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 55/108] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:24.477189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac896-a70a-441e-b1ea-95050258e374 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.482799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.483906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.483906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.484155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/10f7c295046c4a689020e2c69a3e88df/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.486113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, user_id=10f7c295046c4a689020e2c69a3e88df, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:24.487584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47c2d-74bb-480d-9660-0da1eb2f4d5e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:24.508155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 54/109] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:24 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/10f7c295046c4a689020e2c69a3e88df/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 00:59:24.510248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980367a-a17a-4746-b7c8-2e7ecaba2a4f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.516729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980367a-a17a-4746-b7c8-2e7ecaba2a4f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.517182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980367a-a17a-4746-b7c8-2e7ecaba2a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.553971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1980367a-a17a-4746-b7c8-2e7ecaba2a4f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:24.558498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1980367a-a17a-4746-b7c8-2e7ecaba2a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:24.628652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:24.689851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:24.706233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:24.707804 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820905-d922-4f34-846b-5bb06b854c1a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.708232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820905-d922-4f34-846b-5bb06b854c1a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.708678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90820905-d922-4f34-846b-5bb06b854c1a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.713219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac896-a70a-441e-b1ea-95050258e374 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:24.721696 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 56/111] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:24.766912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.767197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.767478 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.792741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:24.793404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:24.793688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:24.793965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:24.794702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:24.795932 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:24.796036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:24.797976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:24.799621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 56/112] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:24 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:24.801075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.888597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:24.889622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:24.940634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795315f6-0a65-4893-add1-62ba3326d121 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.001184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.001855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.002142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.002420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.015706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:25.021553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:25.022596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:25.023466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 57/114] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:25.024227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.039254 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.046972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c96d4-c0a9-43b4-9b84-270978e405c2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.061620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.095898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.096954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.097442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.097918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.100190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.102625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67af585-d826-4f26-84cb-6b52d361201c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.105554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 58/115] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:24 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.110339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927315-ed0a-472a-9e62-50bc5bb64212 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.110669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927315-ed0a-472a-9e62-50bc5bb64212 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.111620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927315-ed0a-472a-9e62-50bc5bb64212 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.113876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 59/116] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:25.114458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927315-ed0a-472a-9e62-50bc5bb64212 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.158294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb959-3bf5-45dc-b317-3a3abed32ca3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.194755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.195329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.195617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.195895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.207602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:25.214447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:25.215339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:25.216088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 58/117] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:25.216760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.247761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927315-ed0a-472a-9e62-50bc5bb64212 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.293144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.294172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.294657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.295126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.296038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:25.297142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.299224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8a0e6-2407-454e-ab26-bfbca552157a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.304433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.318342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 60/118] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.320510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416604ba-5384-4178-b373-010a888cfbdb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.321187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416604ba-5384-4178-b373-010a888cfbdb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.321670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416604ba-5384-4178-b373-010a888cfbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.324851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7198bb-4eb2-4f31-a533-55977afcc7c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.345322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-416604ba-5384-4178-b373-010a888cfbdb None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:25.346847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-416604ba-5384-4178-b373-010a888cfbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:25.363553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.364744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.365174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.365431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/10f7c295046c4a689020e2c69a3e88df/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.367799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, user_id=10f7c295046c4a689020e2c69a3e88df, role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.369433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.382079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.388105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 59/119] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:25 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/10f7c295046c4a689020e2c69a3e88df/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:25.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.440706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 61/120] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:25.441730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416604ba-5384-4178-b373-010a888cfbdb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.527713 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122894-c7e0-4570-a487-249d6fec57ee None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.571216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416604ba-5384-4178-b373-010a888cfbdb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.577110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.579004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.579750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.580498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.582449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:25.583026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.587640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983d47-8ab2-4760-a25a-68afccf5f6d6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.601337 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 60/121] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.603528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edb49-707a-41c9-a0d9-acaa26b67896 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.604018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edb49-707a-41c9-a0d9-acaa26b67896 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.604647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edb49-707a-41c9-a0d9-acaa26b67896 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.606150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 61/122] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:25.607468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edb49-707a-41c9-a0d9-acaa26b67896 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.612637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.626721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.627545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.628033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.628548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.631271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.634046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba25314-0e17-4a82-9160-5c18675c19d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.636463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 62/123] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.638283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.638923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.639586 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.665365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:25.666708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:25.686705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.732148 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edb49-707a-41c9-a0d9-acaa26b67896 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.759967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 63/124] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:25.764827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.790580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.791144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.791430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.791721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.802967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:25.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:25.810341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 62/125] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:25.811316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.882441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:25.902091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7afe89-380c-4d3a-b152-6ba9fda1d752 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.926893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0e35-354d-4943-82b8-42f2cf4615c8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:25.941280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.942257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.942737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.943207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.944686 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.946448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.948277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 64/126] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.949288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.966270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:25.966711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:25.966999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:25.967280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:25.969091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:25.970580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:25.972403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 63/127] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:25.977669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:25.983142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.064400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b991c-de70-4525-8954-81c9b12b5879 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.090365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488579c6-0296-4a13-ac16-dfe0675f23e8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.102052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.103377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.104048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.104760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.106718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.110018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.112949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 65/128] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:26.114540 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.122752 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.130206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.130849 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.131135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.131509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.132149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:26.132509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.134056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.145436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 64/129] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:26.146416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.240854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.253691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539cb0-5ad7-4173-b24c-3597fc7c69c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.261143 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11522-f6a9-4be8-a650-cd40b8a6ec3d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.289084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.290089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.290627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.291098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] PATH_INFO: `/v3/projects/ef52cca5dda7435b87dffb26b76823ed` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.292527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] RBAC: Authorizing `identity:get_project(project_id=ef52cca5dda7435b87dffb26b76823ed)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.294185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.297056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 66/130] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:26 2022] GET /identity/v3/projects/ef52cca5dda7435b87dffb26b76823ed => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:26.298183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.298595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.299319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.299565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.299846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.302332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.303951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.323358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 65/131] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:26 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:26.332614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.419162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.494901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1528ed2-6562-4bf9-af56-64692069e9ca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.495818 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e757f-1be1-4a54-aadd-3faf44979136 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.540731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.543277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.545655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.547560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] PATH_INFO: `/v3/users/350c0fa7bfa44728a54bd1194966675d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.567926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.569052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.570767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.571260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.573662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.575431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.580891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] RBAC: Authorizing `identity:get_user(user_id=350c0fa7bfa44728a54bd1194966675d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.582583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.584848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 66/132] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:26 2022] GET /identity/v3/users/350c0fa7bfa44728a54bd1194966675d => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:26.585701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.612762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 67/133] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 00:59:26 2022] POST /identity/v3/projects => generated 302 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:26.614089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:26.629884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.709273 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44332781-c6fe-422a-8536-f7881048f859 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.725590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.740112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95755c51-7435-4f1d-9951-c5c6e35b3e75 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:26.749672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.750370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.750655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.750929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] PATH_INFO: `/v3/projects/ef52cca5dda7435b87dffb26b76823ed/users/10f7c295046c4a689020e2c69a3e88df/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.753062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef52cca5dda7435b87dffb26b76823ed, user_id=10f7c295046c4a689020e2c69a3e88df, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.754659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ec20-621e-4d0a-bbf1-1bfca15bcea1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.788747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:26.789823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.790354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.790888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.799049 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 67/134] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:26 2022] PUT /identity/v3/projects/ef52cca5dda7435b87dffb26b76823ed/users/10f7c295046c4a689020e2c69a3e88df/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:26.877623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:26.879586 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:26.894588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:26.985888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb608-23c6-470b-8b82-146319b3a97d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.986199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb608-23c6-470b-8b82-146319b3a97d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.986465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb608-23c6-470b-8b82-146319b3a97d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:26.987971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 68/135] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:26.997796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:26.998095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:26.998362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.004180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 68/136] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:27.010737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.036860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:27.037829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:27.135864 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 69/137] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:27.150114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9629-4495-4e3b-a3ad-ede8700911a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:27.161600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.166190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:27.199633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:27.200648 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.201073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.201514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.203042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:27.205097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:27.206965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 69/138] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:27.216341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.295897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e304c-416c-43e4-939f-581556d17baa None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:27.335967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:27.337317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.337742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.338356 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.344482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:27.357869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:27.363746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:27.366578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:27.367535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:27.369725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 70/139] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:27.378693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.527895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f62cf-154c-4ed1-bd84-3b5e1e1d1dcf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:27.547039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427070-4694-4efd-b3af-83baf2c2ea62 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:27.617373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:27.618441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.618955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.619348 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.620177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=350c0fa7bfa44728a54bd1194966675d) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:27.620563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:27.622043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:27.634862 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:27.635046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 70/140] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/role_assignments?user.id=350c0fa7bfa44728a54bd1194966675d&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e405d27a8734458d8f878b2f9da01152 => generated 259 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:27.635819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.636173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.636496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.637239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:27.637557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:27.638994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c2bc-d194-4333-99fa-17b0fcbb03a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:27.656483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 71/141] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:27.662032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.735801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:27.818632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9f12-aa6f-48c9-86f5-d27a6a49a83d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:27.864023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:27.864778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.865067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.865349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.867960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:27.869579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:27.871629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 71/142] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:27.877844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e372-5c0c-4f41-8eb4-f0c6f7123e3c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.878152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:27.878248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e372-5c0c-4f41-8eb4-f0c6f7123e3c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.878490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e372-5c0c-4f41-8eb4-f0c6f7123e3c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.880027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 72/143] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:27.887170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:27.887510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:27.887738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:27.943038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:27.944329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:27.970423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:28.030427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 73/144] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:28.057527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:28.104278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d2c20-d0ae-4560-a2d3-b13f61727fa9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:28.125461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:28.153181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:28.153821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:28.154107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:28.154388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:28.238795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:28.240282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:28.278324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37d85-c7a2-4b4f-8c0c-3af7162e186b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:28.354903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 72/145] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 00:59:28.360371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:28.375094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:28.376167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:28.376493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:28.376765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:28.377572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:28.421746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:28.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:28.427730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:28.428552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:28.436642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 74/146] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:28.437679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:28.473882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:28.511878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637a3a-d734-4db3-94be-34c9e7460314 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:28.549630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:28.550297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:28.550587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:28.550865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:28.552023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:28.553497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:28.555489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 73/147] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:28 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:28.561693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:28.699103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:28.706166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726cf6f-6a80-4bbf-ae21-410f3e0594fa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:28.740761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76669c5-b220-436b-9327-2ba649bfd89b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:28.794483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:28.795183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:28.795466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:28.795743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:28.796691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:28.797002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:28.798397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:28.818502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 75/148] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:28.819390 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:28.820145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:28.820465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:28.820750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:28.821561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:28.821879 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:28.823955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:28.828068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:28.835687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 74/149] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:28 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=65640d9c917344788480a7d50c0694c0 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:28.970844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:29.004675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe34d-8a86-4ffc-9fca-fc5db0ccc7a1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:29.062411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:29.063095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.063386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.063667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.064916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:29.066471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7934701-fcea-4994-b253-78ea9af6f92a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:29.068360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 76/150] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:28 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:29.073722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:29.210139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489887-29f1-43a8-bbf0-794766fd5e64 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:29.247861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:29.248436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.248725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.249004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.266728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:29.337238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:29.338737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:29.366710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1902-26b9-4f75-8a3a-27e2c2a70389 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.367049 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1902-26b9-4f75-8a3a-27e2c2a70389 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.367277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1902-26b9-4f75-8a3a-27e2c2a70389 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.368913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 77/151] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:29.375262 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.375872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.375872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.397842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:29.399084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:29.470646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 75/152] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:29.476768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:29.524547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:29.554491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 78/153] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:29.591363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dd131-77c0-446f-b7e2-2139416c14cd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:29.601790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:29.660627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:29.661285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.661566 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.661843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.663020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:29.664501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:29.666473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 76/154] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:29 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:29.672930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:29.695690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:29.722362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b843-bda5-4417-980f-71670c188723 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:29.786384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:29.786958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.787242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.787515 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.811407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:29.817083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:29.818083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:29.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 79/155] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:29.826775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:29.847977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49388-559d-433e-977e-19ff8f755167 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:29.875075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:29.919061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:29.919706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:29.919994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:29.920292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:29.923878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:29.924195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:29.925699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:29.942018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 77/156] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:29 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:29.980022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a0eb3-3785-4691-a66e-f38279e3ee9e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.019850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.020529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.020814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.021089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.021839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:30.022145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.023595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c5492-63c5-472c-af6a-5a375c155b0e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.029773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.033606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 80/157] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:30.039458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.084589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e04e-cddc-4135-bd98-bdb5c9af99d8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.084923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e04e-cddc-4135-bd98-bdb5c9af99d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.085143 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e04e-cddc-4135-bd98-bdb5c9af99d8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.086548 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 81/158] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:30.092544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8debbe-4ff9-4167-b746-a41cabaec7e6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.092834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8debbe-4ff9-4167-b746-a41cabaec7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.093141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8debbe-4ff9-4167-b746-a41cabaec7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.125353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1a8debbe-4ff9-4167-b746-a41cabaec7e6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:30.126576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1a8debbe-4ff9-4167-b746-a41cabaec7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:30.185242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3982bb-3d39-48a7-b4aa-463aff720da7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.205177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 82/159] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:30.206746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249968b-a1f2-457d-8223-ba10d66447c1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.207040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249968b-a1f2-457d-8223-ba10d66447c1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249968b-a1f2-457d-8223-ba10d66447c1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.212816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 83/160] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:30.227739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.228298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.228418 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.228698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.228973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] PATH_INFO: `/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.229336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.229832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.230150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] RBAC: Authorizing `identity:get_user(user_id=2b9bcfe6d1e745f3b5f4baf8fefbfa18)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.231601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.236298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 78/161] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/users/2b9bcfe6d1e745f3b5f4baf8fefbfa18 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:30.238675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.256202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:30.257419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:30.294356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.338054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:30.339389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.364240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f413-ae64-4c8d-9fdc-f20efe22c704 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.400887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.403369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.404103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.404424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.404703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.415355 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:30.420834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:30.421712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:30.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 79/163] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:30.424136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.458759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abf4e0-f6e1-4bfe-a1af-2c29dc979af4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.500576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.501211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.501498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.501770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.533944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca446ec-7749-4379-bad7-51641bee1953 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.535645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.570146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.570644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.570812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.570991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.571271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.572133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901c32-89db-432a-bb03-63beab2e0def None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.572461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.573905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.575510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 80/164] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:30.576304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.627488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.672317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 85/165] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:30.673609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5af0-f787-4b0e-b3c2-5b12cd02da48 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.673891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5af0-f787-4b0e-b3c2-5b12cd02da48 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.674160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5af0-f787-4b0e-b3c2-5b12cd02da48 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.675422 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 86/166] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:30.676092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5af0-f787-4b0e-b3c2-5b12cd02da48 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.680120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414e7cf-f780-41b7-a1c7-5a1aad4975bc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.714031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.714654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.714936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.715208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.715926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:30.716221 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.717626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.726595 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 81/167] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:30.727338 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.758127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.780605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5af0-f787-4b0e-b3c2-5b12cd02da48 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.815223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.815843 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.816123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.816423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.817115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.818557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042ee7b-141e-4442-9f02-dffba66cda38 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.825979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f20c-5903-45f8-b3d1-77ca0733c0b0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:30.839396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 87/168] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:30 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:30.841744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.842158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.842449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.862974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:30.863366 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:30.864291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:30.864906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:30.865389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:30.865891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:30.867730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:30.869399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:30.871501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 82/169] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:30.877298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:30.877502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.960308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 88/170] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:30.960308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:30.997381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.002057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6e68-8e80-4458-90ac-74b9ed6d694b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.043988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.044704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.044988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.045269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] PATH_INFO: `/v3/users/10f7c295046c4a689020e2c69a3e88df` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.046500 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] RBAC: Authorizing `identity:get_user(user_id=10f7c295046c4a689020e2c69a3e88df)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.047973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.050356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 83/171] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/users/10f7c295046c4a689020e2c69a3e88df => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:31.050478 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.089034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115a79-a3f6-4155-8e3d-e4e508faa960 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.138057 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.138703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.138982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.139255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.140741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:31.141101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.142643 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.154890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 89/172] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:30 2022] GET /identity/v3/role_assignments?user.id=2b9bcfe6d1e745f3b5f4baf8fefbfa18&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:31.155793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.187472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c39d-d29e-4433-86e4-3c5d2a68c105 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.203850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.239226 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.240171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.240624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.241004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.259811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:31.266301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:31.267444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:31.268497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:31.273600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 84/173] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:31.277961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.314882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.338720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853501b-37f2-4f4a-ae5a-017123b28fe1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.393058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.393624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.393904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.394177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.413769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b9b7-76bb-49f1-b711-dbb5ffa8183b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.464212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.464926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.465332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.465614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.466464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:31.466773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.469500 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.480035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 85/174] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:31.480421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.482037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.486513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.493126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.589570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.596229 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9ee8-ad10-4854-a613-b644194f1f50 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.636165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.637485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.638067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.638679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] PATH_INFO: `/v3/users/350c0fa7bfa44728a54bd1194966675d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.641641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] RBAC: Authorizing `identity:get_user(user_id=350c0fa7bfa44728a54bd1194966675d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.644016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.647029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 86/175] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/users/350c0fa7bfa44728a54bd1194966675d => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:31.656862 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.729293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 90/176] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:31.735487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.772319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd891024-7f3c-49d9-985e-a888feff71ca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.833962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.834715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.835066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.835408 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.836698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.838289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.840277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 87/177] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:31.846582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.870524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea870-32be-4d94-9553-6f860ceccdf8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.888656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.904746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:31.941004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.941679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.941965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.942241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] PATH_INFO: `/v3/projects/ef52cca5dda7435b87dffb26b76823ed` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.948992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] RBAC: Authorizing `identity:get_project(project_id=ef52cca5dda7435b87dffb26b76823ed)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:31.950483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:31.952219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 91/178] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/projects/ef52cca5dda7435b87dffb26b76823ed => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:31.957173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87520bf1-d3d8-4d24-9b35-445cb192723c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:31.960871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:31.994441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:31.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:31.996164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:31.996560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/350c0fa7bfa44728a54bd1194966675d/roles/e405d27a8734458d8f878b2f9da01152` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:31.998759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, user_id=350c0fa7bfa44728a54bd1194966675d, role_id=e405d27a8734458d8f878b2f9da01152)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:32.000340 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b4ff-6a48-4299-99a2-bddb99798494 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:32.021864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 88/179] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:31 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/users/350c0fa7bfa44728a54bd1194966675d/roles/e405d27a8734458d8f878b2f9da01152 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 00:59:32.141764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3931ac-5635-49ba-92ee-a9c8b19253f6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:32.198430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:32.199061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:32.199341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:32.199614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:32.200436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=ef52cca5dda7435b87dffb26b76823ed, user.id=10f7c295046c4a689020e2c69a3e88df) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:32.200749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:32.202227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ede1-548b-4d9e-9700-a634ee736f11 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:32.213314 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 92/180] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:31 2022] GET /identity/v3/role_assignments?user.id=10f7c295046c4a689020e2c69a3e88df&scope.project.id=ef52cca5dda7435b87dffb26b76823ed&role.id=65640d9c917344788480a7d50c0694c0 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:33.322103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0528-6dc2-46dc-858f-cae2120f53d8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.322641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0528-6dc2-46dc-858f-cae2120f53d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.322717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0528-6dc2-46dc-858f-cae2120f53d8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.324462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 89/181] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:33.329762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf16a-0814-4b3c-b07c-2888658395f1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.330186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf16a-0814-4b3c-b07c-2888658395f1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.330358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf16a-0814-4b3c-b07c-2888658395f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.352718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a22bf16a-0814-4b3c-b07c-2888658395f1 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:33.353924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a22bf16a-0814-4b3c-b07c-2888658395f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:33.386603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:33.426857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:33.450043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0528-6dc2-46dc-858f-cae2120f53d8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.465872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f754b-d787-43e9-9426-17ec4847f738 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.466493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f754b-d787-43e9-9426-17ec4847f738 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.467025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f754b-d787-43e9-9426-17ec4847f738 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.469266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 94/183] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:33.474695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c4b4-1e91-4b74-8906-8a6aefe14d4d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.475334 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c4b4-1e91-4b74-8906-8a6aefe14d4d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.475820 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c4b4-1e91-4b74-8906-8a6aefe14d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.497882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-01e7c4b4-1e91-4b74-8906-8a6aefe14d4d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:33.500886 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-01e7c4b4-1e91-4b74-8906-8a6aefe14d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:33.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:33.566811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0528-6dc2-46dc-858f-cae2120f53d8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:33.592297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 95/184] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:33.607286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:33.608663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.609190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.609633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.609858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91935dc-c826-4b48-bf35-590fd113e12c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.610133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91935dc-c826-4b48-bf35-590fd113e12c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.610415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91935dc-c826-4b48-bf35-590fd113e12c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.611927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 96/185] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:33.616223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91935dc-c826-4b48-bf35-590fd113e12c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.622471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3139e88a-9a0a-4617-8702-5de6772020cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:33.627887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:33.628849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:33.629634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:33.630228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 90/186] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:33.631559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.631852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.632187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.650591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:33.651726 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:33.726765 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 91/187] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:33.727822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.728841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:33.740478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91935dc-c826-4b48-bf35-590fd113e12c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:33.775878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:33.776569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.776854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.777135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.788614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:33.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:33.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:33.795429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 97/188] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:33.800522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.823279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:33.849813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd01d-c388-42d1-94c7-bdf109f06f17 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:33.886798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:33.887702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.888134 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.888443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.889183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:33.889494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:33.891429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:33.906474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 92/189] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:33.907827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.919810 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d39ff-0885-409a-902b-3bf67941c1c4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:33.958573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:33.959225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:33.959507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:33.959778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:33.960955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:33.962426 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:33.964199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 98/190] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:33.964871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:33.994196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.029618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8aa8-d991-40d5-8c7e-0e36e7373523 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.063780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.064446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.064735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.065016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.065768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:34.066084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.067477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.072863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.079523 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4ab09-49f9-4860-b423-3c9972beba16 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.080412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 93/191] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:34.081601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.124785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.125486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.125721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.125994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.144334 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.145815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.147727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 99/192] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:33 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:34.148355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.194787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd2d6-68e4-494c-83e5-c6b4069f331c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.229131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.230073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.230360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.230638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.231635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.232992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.242282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.262949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67510da-d7aa-4026-a1ab-a6705c6b7e65 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.264897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 94/193] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:34 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:34.265637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.316720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.317504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.317909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.318268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.319696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.322164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.328131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 100/194] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:34.331673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.352182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.412915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd373f-9a49-41b5-8a83-5037825005b9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.453459 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.454025 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.454315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.454594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.462800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e00b8-3d50-48a1-b8c9-6d8210c8c6d7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.504233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.504809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.505092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.505364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.528078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.538124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.539624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3359fa-876e-4e97-afa2-8d2c624ee14a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.589540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.591508 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19250194-27f0-4e05-9c75-89c0e648270e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.607736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.659800 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 95/195] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:34.661515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300256-b29a-40f9-b68e-67350ee32603 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.661809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300256-b29a-40f9-b68e-67350ee32603 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.663197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300256-b29a-40f9-b68e-67350ee32603 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.664558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 96/196] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:34.665276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a300256-b29a-40f9-b68e-67350ee32603 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.737519 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 101/197] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:34.739072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.739373 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.739655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.764901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:34.770295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:34.803319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a300256-b29a-40f9-b68e-67350ee32603 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:34.833884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:34.851090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:34.852364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:34.853267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:34.854034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:34.855703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:34.858106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:34.860450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 97/198] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:34.862547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.866835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 102/199] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:34.869637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:34.907884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:35.013103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c424a-a94f-44ae-be46-fa2ff33f41a6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1f93-bc5b-4938-8eb6-019d7073faab None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.050503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.051198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.051513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.051856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.053376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:35.055150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:35.055386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.056158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.056609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.057213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 98/200] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:35.057493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.057995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:35.058664 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=f71c64698a2b4599a33c90b13e9950c3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:35.059116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:35.060920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:35.067759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 103/201] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:34 2022] GET /identity/v3/role_assignments?user.id=f71c64698a2b4599a33c90b13e9950c3&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:35.068941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:35.177634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:35.259783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:35.264545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2d80-4ac4-4f32-95c0-a66970c0b154 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.277168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb333-0a0f-4ff6-97c6-d1f7b0239eea None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.304051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.304708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.304989 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.305266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.306162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=f71c64698a2b4599a33c90b13e9950c3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:35.306532 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:35.308235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:35.314282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 104/202] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:35 2022] GET /identity/v3/role_assignments?user.id=f71c64698a2b4599a33c90b13e9950c3&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:35.342351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.343108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.343399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.343681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.367838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:35.373655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:35.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:35.375443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 99/203] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:35.381384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:35.503299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba573-c2cc-458d-8295-eb063bead214 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.515626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:35.541435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.542151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.542435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.542710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.543450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:35.543755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:35.545239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:35.555905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 105/204] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:35.565395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:35.712881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8455c-625f-4fb0-a713-db6ca52bd15d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.751546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.752216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.752532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.752815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] PATH_INFO: `/v3/users/350c0fa7bfa44728a54bd1194966675d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:35.754091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] RBAC: Authorizing `identity:get_user(user_id=350c0fa7bfa44728a54bd1194966675d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:35.755660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:35.757633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 100/205] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:35 2022] GET /identity/v3/users/350c0fa7bfa44728a54bd1194966675d => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:35.763030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:35.929610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a9733-4cad-49be-be00-205202b2b809 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:35.979505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:35.980210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:35.980560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:35.980867 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.036434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:36.074874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:36.076389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:36.209639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 106/206] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:36.216301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:36.256514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:36.371116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fe09-693a-4674-9830-fa6d37e37be2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:36.415372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:36.416133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.416688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.417210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.419406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:36.421112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f220-edac-4e3b-ac93-831d13169df3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:36.428662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 101/207] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:36 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:36.429588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:36.538966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:36.571256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa773f-d89f-44dd-876f-1e757eaf0bf6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:36.612929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:36.613915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.614395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.614863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.615851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0, user.id=350c0fa7bfa44728a54bd1194966675d) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:36.616409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:36.618069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef4ab-c4b8-49ef-812c-a4283be5d3c8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:36.627016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 107/208] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:36 2022] GET /identity/v3/role_assignments?user.id=350c0fa7bfa44728a54bd1194966675d&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e405d27a8734458d8f878b2f9da01152 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:36.856962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdef85-ffc1-42f7-8a30-58a2d98553c8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.857147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdef85-ffc1-42f7-8a30-58a2d98553c8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.857439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdef85-ffc1-42f7-8a30-58a2d98553c8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.859614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 102/209] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:36.865576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4353e-6d4c-40c7-8a6f-257fc7b38e0b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.865864 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4353e-6d4c-40c7-8a6f-257fc7b38e0b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.866149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4353e-6d4c-40c7-8a6f-257fc7b38e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.885425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-32d4353e-6d4c-40c7-8a6f-257fc7b38e0b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:36.886619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-32d4353e-6d4c-40c7-8a6f-257fc7b38e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:36.961725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae84e9-5fd7-42c2-8a3e-f11c3c426d6c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.962040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae84e9-5fd7-42c2-8a3e-f11c3c426d6c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.962342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae84e9-5fd7-42c2-8a3e-f11c3c426d6c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.963187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 108/210] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:36.964494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 103/211] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:36.970947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:36.971236 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:36.971529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:36.988231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae84e9-5fd7-42c2-8a3e-f11c3c426d6c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:36.990352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:36.991624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:37.074674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.085466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 109/212] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:37.112603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.113842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.141173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae84e9-5fd7-42c2-8a3e-f11c3c426d6c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.185285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.186296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.187326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.188216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.202096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:37.209652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:37.210707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:37.211670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:37.213978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 104/213] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:37.220302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cf99-679f-4177-a6f4-0cc63d6d0b27 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.284970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.285948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.286342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.286738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.288051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:37.290088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:37.297404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 110/214] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:37.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.349767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92952bdd-b897-4111-b577-55504778b9a0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.394940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.396518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.396947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.397554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.398762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:37.399484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:37.401240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:37.407489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4901d-b622-425e-ba80-27534e953f46 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.412836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 105/215] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:37.418643 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.419836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.439040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.459883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.460584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.460901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.461205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.461979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:37.463587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded57b-921f-413a-be64-503db3a4bc9e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:37.487009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 111/216] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:37 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:37.488427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62265acd-29c8-427d-9534-42602fe5a8ca None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.488927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62265acd-29c8-427d-9534-42602fe5a8ca None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.489031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62265acd-29c8-427d-9534-42602fe5a8ca None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.490379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 112/217] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:37.495997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.496411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.496606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.520139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:37.521825 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:37.569709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87597e-4867-4e63-a5a4-2ead5f09e3d3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.620443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 113/218] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:37.628520 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.629576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.630111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.630585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] PATH_INFO: `/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.640577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.651371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] RBAC: Authorizing `identity:get_user(user_id=a6805a20e37a4a668c6d6e0d6bfebf91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:37.652882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:37.654839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 106/219] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:37.660967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.700656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.750978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:37.764355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff9060-6ec7-422e-8c7c-136fb8be15b6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.798503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f55e-5718-4d3c-a020-484736d807ad None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.815149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.816378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.817009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.817483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.830636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8ab9b125-1f7c-4d88-a5cb-4b0a2d6d126a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:37.836596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:37.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:37.838281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:37.840778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 114/220] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:37.842992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910274b1-9947-40e2-a2f1-1ffc68116ff2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.843213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:37.843739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910274b1-9947-40e2-a2f1-1ffc68116ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.843844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:37.844122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:37.844426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.844760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910274b1-9947-40e2-a2f1-1ffc68116ff2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:37.846414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 115/221] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:37.847495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910274b1-9947-40e2-a2f1-1ffc68116ff2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:37.931163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:37.933095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:37.982313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910274b1-9947-40e2-a2f1-1ffc68116ff2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:37.998091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.019618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.034694 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.036099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.036758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.037342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.038272 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:38.038777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.041129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b7ec-7897-4025-b384-f17a32e53ad6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.052819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 116/222] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.054091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.054384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.054693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.070163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 107/223] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 00:59:38.071790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.076789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:38.078595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:38.160466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 117/224] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:38.161439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.206394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56428d-a484-4b1a-8819-3a87642c368c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.244351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.245145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.245473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.247090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.248747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.250655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 108/225] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.251477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.279183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f28db-5257-4b58-a0e1-c5f7e188c48a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.280831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.296597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.317424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.318079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.318359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.318632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.319910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.321480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.323269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 118/226] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.329460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.376103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fa6f-8028-450e-b3d0-889830c6ef24 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.417975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.418720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.418988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.419276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.431658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:38.438266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:38.439140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:38.439904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:38.440516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92777530-7a8b-482b-9d9e-99dee7f0b7b1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.440599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 109/227] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:38.444760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.482672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.484033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.484218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.485666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.485845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.487212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.489038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 119/228] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.494628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.537826 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.565852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.572860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6b0-f14f-473f-812d-8a8f89856533 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.606852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba257d-99bd-419c-a887-645d70094eca None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.619838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.620413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.620744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.621045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.621999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=a6805a20e37a4a668c6d6e0d6bfebf91) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:38.622575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.625203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.633682 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 110/229] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/role_assignments?user.id=a6805a20e37a4a668c6d6e0d6bfebf91&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=65640d9c917344788480a7d50c0694c0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.634565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.648193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.649214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.649783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.650390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.651303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:38.651802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.653517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.663911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 120/230] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:38.681174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.783180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8ac5a-06b1-43b1-8e9c-20aca9a4793b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.835703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.835932 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.836212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/f71c64698a2b4599a33c90b13e9950c3/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.838243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, user_id=f71c64698a2b4599a33c90b13e9950c3, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.840269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.852245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:38.857566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3ed7-5710-4c25-ac14-75c89457e5c2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:38.860307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 111/231] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:38 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/f71c64698a2b4599a33c90b13e9950c3/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:38.931942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:38.933230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:38.933607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:38.933977 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:38.935299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:38.936933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:38.939018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 121/232] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:38.944282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:38.972785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:39.067328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57dc4-acc0-4f47-a684-d2191080c344 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:39.107352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:39.108809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:39.109234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:39.109653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:39.112682 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:39.114325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c327319-3aa9-48cd-b10e-5f7c92bcc650 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:39.116530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 112/233] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:38 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:39.122313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:39.251379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7186db8-c654-49d2-93be-26102791c01b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:39.295554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:39.296895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:39.297185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:39.297469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/f71c64698a2b4599a33c90b13e9950c3/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:39.299809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, user_id=f71c64698a2b4599a33c90b13e9950c3, role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:39.301308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff60921-569b-414b-b340-bbd3ed70c363 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:39.317439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 122/234] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:39 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/f71c64698a2b4599a33c90b13e9950c3/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:40.022630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f86b-617a-4f2b-b65a-036b1079586e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.023182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f86b-617a-4f2b-b65a-036b1079586e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.023182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f86b-617a-4f2b-b65a-036b1079586e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.024850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 113/235] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:40.031113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.031590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.031662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.059317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:40.060564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:40.091749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:40.115648 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88a7c-92e9-44c9-baa2-7bbb0dab0bc2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.116056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88a7c-92e9-44c9-baa2-7bbb0dab0bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.116488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88a7c-92e9-44c9-baa2-7bbb0dab0bc2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.118621 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 114/236] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:40.124972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.125273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.125544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.162199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:40.163452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:40.206311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 123/237] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:40.268990 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:40.294766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 115/238] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:40.349271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:40.381553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:40.408808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8f8a-8b70-4f81-97b1-f9b5dd6f14eb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:40.467346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:40.468329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.468788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.469211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.471655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:40.473305 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:40.475954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 124/239] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:40.482967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:40.516984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea2952-aad1-4000-aee2-41bb9d159b36 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:40.538673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:40.636819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae85939-a480-412d-847b-97a2fd79aa3f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:40.637650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:40.638436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.638810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.639184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.660275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:40.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:40.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:40.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:40.676679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 116/240] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:40.680504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:40.701577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:40.703136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.703784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.704496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.705544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:40.707401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:40.734118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 125/241] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:40 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 00:59:40.791513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:40.817180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8060-ab60-4b45-80f2-facea12a818a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:40.855076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:40.856096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:40.856602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:40.857096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:40.858073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:40.858770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:40.860485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:40.870448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 117/242] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:40.876930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:40.997524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.022127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca211cb-1119-4318-bbec-2cddfcf1d44d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.062925 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.064454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.065153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.065648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] PATH_INFO: `/v3/users/d824310f4ac5465a8c25372671914c17` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.080617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] RBAC: Authorizing `identity:get_user(user_id=d824310f4ac5465a8c25372671914c17)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:41.082387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a114ddc-bed4-4141-9b53-550f42cc1a41 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:41.084650 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 126/243] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:40 2022] GET /identity/v3/users/d824310f4ac5465a8c25372671914c17 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:41.093848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.205883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7674e-a3b3-40c4-861f-6874bd37d758 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.246651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5a10-25ef-4270-bd8a-6f30fe6af7f5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.247219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5a10-25ef-4270-bd8a-6f30fe6af7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.247816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5a10-25ef-4270-bd8a-6f30fe6af7f5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.253520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 127/244] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:41.254435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.255549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.255829 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.256101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.267333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de92e-6fbe-465d-b2d9-1c128ec9e324 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.268150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de92e-6fbe-465d-b2d9-1c128ec9e324 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.268924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de92e-6fbe-465d-b2d9-1c128ec9e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.275071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.298911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e58de92e-6fbe-465d-b2d9-1c128ec9e324 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:41.301194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e58de92e-6fbe-465d-b2d9-1c128ec9e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:41.356859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:41.358747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:41.393993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 128/245] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:41.398113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f24dd-8b5f-4c92-b096-7f904f300466 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.398403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f24dd-8b5f-4c92-b096-7f904f300466 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.398679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f24dd-8b5f-4c92-b096-7f904f300466 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.400071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 129/246] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:41.405180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.405463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.405736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.427703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:41.427703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:41.480124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 118/247] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:41.481869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.500422 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.506848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 130/248] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:41.507698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.542701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.633681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f87fc-6a7c-4026-8fd5-044591cbead8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.654020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d150-a846-4582-9565-c6f6e08ef0d9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.698113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.698775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.699057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.699333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.704271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.704929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.705206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.707030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:41.708538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:41.710629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 131/249] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:41.711421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.737383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:41.742777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:41.743649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:41.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 119/250] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:41.749454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.829955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.870183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:41.873263 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9d90-0d66-4635-8629-d8248dcb0203 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.915047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.915880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.916162 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.916594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:41.917408 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=d824310f4ac5465a8c25372671914c17) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:41.917986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:41.919709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:41.927446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651236d1-6d89-4676-8280-a66a8246f34d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:41.930041 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 120/251] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/role_assignments?user.id=d824310f4ac5465a8c25372671914c17&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e405d27a8734458d8f878b2f9da01152 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:41.930885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:41.998543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:41.999375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:41.999706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:41.999991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.012024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:42.017835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:42.019232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:42.020498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 132/252] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:42.031001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.132391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309f32-7bbe-49b8-9151-9133f1d3fe8e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.149300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6564d-4a44-46d5-9002-bc0db1f3b45c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.169559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.170431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.170857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.171232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.172099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:42.172546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.174046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.183434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 121/253] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:42.187073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:42.190010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.197722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.198661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.198938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.199682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:42.199994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.201575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.211834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 133/254] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:42.217377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.222857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:42.310746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aff9f-3d89-4752-b9ef-b5b3df9901fc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.345984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed4c9-27ab-477d-87c6-ceda362da38e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.380061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.380757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.381044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.381323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] PATH_INFO: `/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.382673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] RBAC: Authorizing `identity:get_user(user_id=a6805a20e37a4a668c6d6e0d6bfebf91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.384184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b6bc-2cd0-4c0e-b641-78dec332aeae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.386519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 122/255] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:42.387689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380a55-4a4e-4c72-9de7-03efade0e510 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.387974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380a55-4a4e-4c72-9de7-03efade0e510 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.388270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380a55-4a4e-4c72-9de7-03efade0e510 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.389535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 123/256] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:42.396744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380a55-4a4e-4c72-9de7-03efade0e510 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.403133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.404053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.404356 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.404627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.409296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.411578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a747f6d-d0fe-45d1-988e-49e7e57f3213 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.414171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 134/257] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:42.421222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.421506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.421781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.449847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:42.450722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:42.513705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:42.521491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 135/258] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:42.522487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.567910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:42.578800 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380a55-4a4e-4c72-9de7-03efade0e510 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.646973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.648036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.648603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.649185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.653473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.657321 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.661768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1684497-790a-4f5f-9a99-8cb9d8714e90 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.667898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 124/259] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:42.668797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:42.704390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.705075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.705353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.705681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.778404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:42.800562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:42.802037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:42.862031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1f0a-73c8-43e5-9216-d3b0a684f312 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:42.903043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:42.903625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:42.903906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:42.904179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:42.916507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:42.923131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:42.924241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:42.925156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:42.929359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 125/260] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:42.930132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:43.041335 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecffe8a-f58a-4667-beee-385f4e6ec95c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.079492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.080334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.080691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.081033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/a6805a20e37a4a668c6d6e0d6bfebf91/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:43.083660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, user_id=a6805a20e37a4a668c6d6e0d6bfebf91, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:43.085436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:43.109466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 126/261] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:42 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/a6805a20e37a4a668c6d6e0d6bfebf91/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:43.109466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.111389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 136/262] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:43.120323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.256774 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:43.295182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503974a-0b67-4833-9a07-43be174af7b9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.320569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:43.362592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07853b11-5382-4a2e-82b8-c2e6a1783f79 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.366355 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.367002 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.367291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.367572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:43.368332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:43.368643 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:43.370029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:43.389889 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 127/263] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:43.396202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.448071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.448771 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.449059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.449335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:43.452091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:43.453624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:43.455834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 137/264] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:43 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:43.465367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.624999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e18e-e68b-4ba6-bff8-577135a853e1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d53c-829e-4b8f-a347-86777f01bb2c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.700281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.701198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.701480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.702711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:43.703526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=f71c64698a2b4599a33c90b13e9950c3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:43.703835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:43.705460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:43.718333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 138/265] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:43 2022] GET /identity/v3/role_assignments?user.id=f71c64698a2b4599a33c90b13e9950c3&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:43.730403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.731521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.732029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.732547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] PATH_INFO: `/v3/users/f71c64698a2b4599a33c90b13e9950c3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:43.734480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] RBAC: Authorizing `identity:get_user(user_id=f71c64698a2b4599a33c90b13e9950c3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:43.736128 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4418b3-5f0c-4978-822a-792ff835db15 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:43.742505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 128/266] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:43 2022] GET /identity/v3/users/f71c64698a2b4599a33c90b13e9950c3 => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:43.743916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:43.781985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:43.892359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf71b8-e190-43d9-9cde-d06b106b74bd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:43.938321 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:43.938972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:43.939255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:43.939532 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.012354 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.015108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.044384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.137429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705fcf-8463-436e-87e2-f2b11b73b21f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.137719 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705fcf-8463-436e-87e2-f2b11b73b21f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.138001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705fcf-8463-436e-87e2-f2b11b73b21f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.139881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 129/267] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:44.145837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db0c8-a32e-42e9-a60e-8f4d4e573a7f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.146082 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db0c8-a32e-42e9-a60e-8f4d4e573a7f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.146336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db0c8-a32e-42e9-a60e-8f4d4e573a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.172129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3a1db0c8-a32e-42e9-a60e-8f4d4e573a7f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:44.173767 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 139/268] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:44.173881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3a1db0c8-a32e-42e9-a60e-8f4d4e573a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:44.179408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.192095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.276208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 130/269] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:44.278516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52e91-1aea-46a2-afb3-8e4061ed090c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.279096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52e91-1aea-46a2-afb3-8e4061ed090c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.279599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52e91-1aea-46a2-afb3-8e4061ed090c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.281255 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 131/270] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:44.287139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.287709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.288182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.312797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:44.314350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:44.335829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4c7-e2c0-4c0a-9c16-10014e65e90d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.360492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.378406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.379072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.379357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.379634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.380882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.382405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.384519 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 140/271] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:44.385306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.403409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 132/272] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:44.404700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.492235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783523-c7a8-425f-b231-c6c2f51a849c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.504373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.530186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.530834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.531121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.531395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.539865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8c6f-f5a6-46d9-b540-7f26a913e8c0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.542151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:44.547352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:44.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:44.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 141/273] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:44.549947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.580609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.581508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.582029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.582469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.583473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=f71c64698a2b4599a33c90b13e9950c3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:44.584010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.585911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.593137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 133/274] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/role_assignments?user.id=f71c64698a2b4599a33c90b13e9950c3&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:44.594333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.602936 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.708139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50f57-ab1a-43f7-9f1d-7e53f7ad77a8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.763098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.764101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.765172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.765646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.767069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.768867 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.770897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 142/275] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:44.777247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.788452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8dd7e-5a73-4b39-8d8e-9d92bf5eb9c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.827657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.828222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.828981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.828981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.829536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:44.829844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.831231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defd590-a3c2-4d7e-8e74-96d9411d680f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.833792 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.841037 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 134/276] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:44.843257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977a33-ae56-48af-8625-085b5d1bf6db None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.843257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977a33-ae56-48af-8625-085b5d1bf6db None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.843257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977a33-ae56-48af-8625-085b5d1bf6db None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.844406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 135/277] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:44.849179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977a33-ae56-48af-8625-085b5d1bf6db None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:44.922410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3d7c-ccb2-4502-bc07-b8808129bc1a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.940470 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:44.960947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:44.961492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.961773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.962044 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:44.962729 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:44.964182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249788c0-c883-417f-9028-494fe8e4fb90 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:44.977899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977a33-ae56-48af-8625-085b5d1bf6db None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:44.986818 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 143/278] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 00:59:44 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 00:59:44.988221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:44.988541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:44.988816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.017789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:45.019328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:45.025150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.026164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.026661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.027117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] PATH_INFO: `/v3/users/ad88c252f5a54fa4a42864566516e202` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.042941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=ad88c252f5a54fa4a42864566516e202)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:45.044924 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:45.047622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 136/279] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:44 2022] GET /identity/v3/users/ad88c252f5a54fa4a42864566516e202 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:45.054405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:45.124482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 144/280] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:45.140657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:45.154560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:45.188210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673024a-c611-4dbb-8ed9-69e99dc66bd8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:45.237806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.238788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.239451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.239741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.243033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, user.id=ad88c252f5a54fa4a42864566516e202, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:45.243033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:45.243236 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:45.250846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 137/281] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Jul 31 00:59:45 2022] GET /identity/v3/role_assignments?user.id=ad88c252f5a54fa4a42864566516e202&scope.system=all&role.id=65640d9c917344788480a7d50c0694c0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:45.281846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c89dc-62d9-4baf-9eb0-6601eba73667 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:45.283938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:45.327835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.328534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.328822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.329103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.342255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:45.347487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:45.348427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:45.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 145/282] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:45.355106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:45.481463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0571c-14c5-4714-96dd-e45b309eca12 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:45.503418 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:45.521230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.521870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.522159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.522442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.523170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:45.523480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:45.524955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:45.534456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 138/283] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:45.540036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:45.679397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a826-1cb8-437f-b7e4-1139a9c115e7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:45.717713 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.718417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.718707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.718984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] PATH_INFO: `/v3/users/d824310f4ac5465a8c25372671914c17` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.720230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] RBAC: Authorizing `identity:get_user(user_id=d824310f4ac5465a8c25372671914c17)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:45.721817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec903cc-4a87-441c-b059-d4b9b783200e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:45.723728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 146/284] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:45 2022] GET /identity/v3/users/d824310f4ac5465a8c25372671914c17 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:45.729579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:45.806401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad013927-9251-44e1-949f-06fcfbb8167f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.806607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad013927-9251-44e1-949f-06fcfbb8167f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.807684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad013927-9251-44e1-949f-06fcfbb8167f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.810090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 147/285] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:45.826301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.826627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.827486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.854405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:45.855991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:45.889717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:45.924410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c5f7-fada-4006-9926-7838c52cdaab None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:45.983657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:45.984336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:45.984628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:45.984908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:45.986812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:45.988278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:45.997896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 148/286] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:45.998130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 139/287] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:45 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:46.000133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:46.021124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:46.088721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:46.188274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b85dd-84de-4809-a758-95098f006af4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:46.205179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2215c8-9bfd-48a8-85e5-16ca5b34cc70 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:46.258306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:46.258994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:46.259332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:46.259616 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/d824310f4ac5465a8c25372671914c17/roles/e405d27a8734458d8f878b2f9da01152` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:46.261687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, user_id=d824310f4ac5465a8c25372671914c17, role_id=e405d27a8734458d8f878b2f9da01152)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:46.263182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:46.277042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:46.277729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:46.278054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:46.278333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:46.278652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 149/288] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 00:59:45 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/users/d824310f4ac5465a8c25372671914c17/roles/e405d27a8734458d8f878b2f9da01152 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 00:59:46.294424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:46.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:46.306826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:46.307855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:46.308580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 140/289] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:46.315385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:46.348816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:46.450679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20c69-5c31-44f5-8696-da3dd7abb272 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:46.493388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:46.494092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:46.494418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:46.494705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:46.495534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:46.495860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:46.497464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:46.506934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 150/290] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:46.512760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:46.624866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e18-1038-47c5-80c0-f0ec80e0a82e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:46.644151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:46.680104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:46.680824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:46.681142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:46.681446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] PATH_INFO: `/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:46.682988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] RBAC: Authorizing `identity:get_user(user_id=a6805a20e37a4a668c6d6e0d6bfebf91)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:46.684513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:46.686370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 141/291] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:46 2022] GET /identity/v3/users/a6805a20e37a4a668c6d6e0d6bfebf91 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:46.692123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:46.813587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:46.839120 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9a1c-0455-4968-9979-3a6593db7cb2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:46.884049 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:46.885023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:46.885497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:46.885983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:46.982966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:46.984472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:47.097380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:47.136919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 151/292] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:47.145358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:47.300436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6128-158c-4db1-a163-1326631313dd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:47.348959 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:47.350000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.350481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.350951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.352472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:47.354189 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1fd85-277a-4216-b456-dad72c18aedc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:47.356109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 142/293] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:47 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:47.362773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:47.491480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50ed2a-57ae-4da9-a399-1701022cc26c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:47.530741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:47.531378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.531661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.531932 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.532779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=a6805a20e37a4a668c6d6e0d6bfebf91) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:47.533091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:47.534633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0daae-b81e-4f6a-9afb-3cfd25d25005 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:47.541303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 152/294] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:47 2022] GET /identity/v3/role_assignments?user.id=a6805a20e37a4a668c6d6e0d6bfebf91&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=65640d9c917344788480a7d50c0694c0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:47.795135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a00-295f-454f-88b5-c9c520fe5558 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.796173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a00-295f-454f-88b5-c9c520fe5558 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.796738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228a00-295f-454f-88b5-c9c520fe5558 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.798580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 143/295] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:47.804269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.804558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.804832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.832304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:47.833822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:47.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:47.907441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d41d-e8e8-40f0-8e1c-251a37494b2a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.907762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d41d-e8e8-40f0-8e1c-251a37494b2a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.908008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d41d-e8e8-40f0-8e1c-251a37494b2a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.909540 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 144/296] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:47.915052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c997-a483-4860-ad16-c78629f3723b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:47.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c997-a483-4860-ad16-c78629f3723b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:47.915640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c997-a483-4860-ad16-c78629f3723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:47.924225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 153/297] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:47.945911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f143c997-a483-4860-ad16-c78629f3723b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:47.947350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f143c997-a483-4860-ad16-c78629f3723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:47.949105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.003026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.032624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 145/298] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:48.055578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c997-a483-4860-ad16-c78629f3723b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.077570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa87cb-1b21-4b97-a9c2-c0d5aaf57dbe None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.115077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.115993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.116445 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.116874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.118155 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.119742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23a79-7b8f-4061-996c-124c24689f2f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.121382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 154/299] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:48.127704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82c8f-cd9b-48bd-9b7c-44d8ddbda295 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.127992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82c8f-cd9b-48bd-9b7c-44d8ddbda295 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.128287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82c8f-cd9b-48bd-9b7c-44d8ddbda295 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.130207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 155/300] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:48.130938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b82c8f-cd9b-48bd-9b7c-44d8ddbda295 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.174851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c997-a483-4860-ad16-c78629f3723b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.179641 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.213169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.213936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.214220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.214488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.225386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-57b3eda9-f7b2-4555-8c88-2cd5d0a05e61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:48.230866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:48.231733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:48.232552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 146/301] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:48.234526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.234640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.234911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b82c8f-cd9b-48bd-9b7c-44d8ddbda295 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.252538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:48.253736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:48.283650 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.284307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.284598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.284878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] PATH_INFO: `/v3/groups` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.285559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.286998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.287695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.304802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 156/302] 10.222.0.40 () {60 vars in 1134 bytes} [Sun Jul 31 00:59:48 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 00:59:48.309269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.340915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 147/303] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:48.367743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.435467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4e91f-43d6-44cc-9bd9-c6ea7a1c3cac None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.439572 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.489235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.491127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.491625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.492119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.493084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:48.493583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.495154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.501649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6093be4-ea3a-46cb-a657-cc15e980ca40 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.504685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 157/304] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:48.516566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.548836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.549134 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.549416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.564654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:48.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:48.571713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:48.572529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 148/305] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:48.578558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.614916 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.641589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a655-3698-42d7-8d69-839f56e493fb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.678152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.678807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.679113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.679413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] PATH_INFO: `/v3/users/ad88c252f5a54fa4a42864566516e202` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.680657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=ad88c252f5a54fa4a42864566516e202)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.682444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776042-9bca-4f34-9c06-ba4382767fd9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.689034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 158/306] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/users/ad88c252f5a54fa4a42864566516e202 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:48.689034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247866-74dc-41d2-a8af-04d39a7dbf65 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.689034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247866-74dc-41d2-a8af-04d39a7dbf65 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.689034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247866-74dc-41d2-a8af-04d39a7dbf65 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.689034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 159/307] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:48.689719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0247866-74dc-41d2-a8af-04d39a7dbf65 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.702286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0790138-286c-407f-b8ff-dbd1c36fbe96 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.727016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:48.741780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.742498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.742784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.743061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.743779 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:48.744092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.745612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1e93-01c1-44fe-83a9-ed785e49dd15 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.755707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 149/308] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:48.757383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.757383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.757689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.776592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:48.777862 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:48.808424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0247866-74dc-41d2-a8af-04d39a7dbf65 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:48.849468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:48.850060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:48.850346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:48.850628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] PATH_INFO: `/v3/system/users/ad88c252f5a54fa4a42864566516e202/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:48.852094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ad88c252f5a54fa4a42864566516e202, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:48.853566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:48.859472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 150/309] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:48.860943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.869733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 160/310] 10.222.0.40 () {58 vars in 1334 bytes} [Sun Jul 31 00:59:48 2022] PUT /identity/v3/system/users/ad88c252f5a54fa4a42864566516e202/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 00:59:48.885459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:48.897801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.010204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.016156 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85164-12d3-46b4-88e3-5f87a9280999 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.024755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc503e2-2462-4213-b030-61b1eda90f0b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.062931 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.063689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.063971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.064401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.075918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:49.076502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.077917 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.078402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.078878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] PATH_INFO: `/v3/users/9554799a15964df1b39f102d80dfdd6b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:49.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:49.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:49.084409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:49.092277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 161/311] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:49.094464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:49.101413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] RBAC: Authorizing `identity:get_user(user_id=9554799a15964df1b39f102d80dfdd6b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.103640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.105914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 151/312] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:48 2022] GET /identity/v3/users/9554799a15964df1b39f102d80dfdd6b => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:49.117302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:49.230258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.239801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6ae3-1287-4697-b1f1-4dfcbe2e5fd2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.265506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd388c-9126-4c04-b27e-188e4492e129 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.279602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.280922 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.281309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.281683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.282570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:49.282976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.284478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.300291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 162/313] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:49.301627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:49.309478 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.310299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.310749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.311193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.312125 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, user.id=9554799a15964df1b39f102d80dfdd6b, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:49.312605 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.314770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.322279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 152/314] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/role_assignments?user.id=9554799a15964df1b39f102d80dfdd6b&scope.system=all&role.id=e405d27a8734458d8f878b2f9da01152 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:49.345025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.427371 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b297-6459-4caf-8198-aed3d74c6a1a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.469228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.469983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.470164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.470442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] PATH_INFO: `/v3/users/d824310f4ac5465a8c25372671914c17` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.471662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] RBAC: Authorizing `identity:get_user(user_id=d824310f4ac5465a8c25372671914c17)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.473180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.475185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 163/315] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/users/d824310f4ac5465a8c25372671914c17 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:49.481016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:49.601510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebd3a-afd0-4547-975e-761c21d3c8db None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.638878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.640137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.640448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.640724 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.652504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.713892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.715293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.820172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 153/316] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:49.829385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:49.928622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:49.944214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789c5f-063d-4374-99c7-2cb4852c12cd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:49.981512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:49.982519 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:49.983043 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:49.983539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:49.984968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:49.986633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5544b25-940a-4599-88b8-c8563beb95b2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:49.988878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 164/317] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:49.994594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:50.042628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:50.107658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33290132-6e51-4b13-bc77-f0e0b3c4c77c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:50.144811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:50.145441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.145728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.146005 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.146801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c, user.id=d824310f4ac5465a8c25372671914c17) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:50.147111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:50.148570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cd652-b745-4eb4-a861-0630f211e7f9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:50.160396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 154/318] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 00:59:49 2022] GET /identity/v3/role_assignments?user.id=d824310f4ac5465a8c25372671914c17&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e405d27a8734458d8f878b2f9da01152 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:50.548320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630abf-9ea6-45e9-a431-a81703a6f661 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.548847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630abf-9ea6-45e9-a431-a81703a6f661 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.549132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630abf-9ea6-45e9-a431-a81703a6f661 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.550573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 165/319] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:50.556307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.556610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.556997 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.575499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:50.576764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:50.646203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 155/320] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:50.668748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630abf-9ea6-45e9-a431-a81703a6f661 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:50.773276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630abf-9ea6-45e9-a431-a81703a6f661 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:50.808390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:50.808950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.809235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.809512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:50.812165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6c184-b730-4f7a-b84f-e4bfeec87b9f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:50.814288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 166/321] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 00:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:50.819623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:50.855274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:50.925548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42c79-6a09-4e7c-923c-30837dcc4717 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:50.960691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:50.961325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.961606 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.961880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] PATH_INFO: `/v3/groups` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.962545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:50.964004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:50.970649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef468-6197-4b09-8ab8-e0d7d15d63fa None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.970941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef468-6197-4b09-8ab8-e0d7d15d63fa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.971221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef468-6197-4b09-8ab8-e0d7d15d63fa None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.972607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 167/322] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:50.977851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:50.978359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:50.978817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:50.984674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 156/323] 10.222.0.40 () {60 vars in 1134 bytes} [Sun Jul 31 00:59:50 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 00:59:51.007122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:51.008383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:51.030632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:51.088900 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 168/324] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:51.112826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.226186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:51.235158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1aec0-f23e-47b4-907f-98043a3821d2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.272575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.273214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.273421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.273693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.287043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dd20c333-0e2e-4cec-b3ef-10f940a22cf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:51.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:51.293450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:51.294235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 157/325] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:51.303093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.390963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275265d7-f435-4ba0-b50a-54258df7c424 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.391260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275265d7-f435-4ba0-b50a-54258df7c424 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.391444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275265d7-f435-4ba0-b50a-54258df7c424 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.392832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 158/326] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 00:59:51.408181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.408516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.408798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.420482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8450e25-217e-4c53-ab82-f027c6327d65 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.432860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:51.434077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:51.470593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.471507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.471796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.472076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.473517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:51.473833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:51.475720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:51.486769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 169/327] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:51.492404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.513978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:51.525597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 159/328] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:51.544721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbc62c-20f7-422f-8efc-c1f8b251b8fd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.637470 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:51.647359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.648405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.648930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.649398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] PATH_INFO: `/v3/users/ad88c252f5a54fa4a42864566516e202` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.650907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] RBAC: Authorizing `identity:get_user(user_id=ad88c252f5a54fa4a42864566516e202)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:51.652595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:51.659238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3434c-c936-4ad0-ad26-c5be4d063dba None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.659605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 170/329] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/users/ad88c252f5a54fa4a42864566516e202 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:51.661504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.695785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.696494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.696781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.697057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.708763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:51.715241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:51.716154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:51.721155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 160/330] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:51.735222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:51.765569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:51.784625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440fb86-7cca-48b6-b0f2-780780a3a699 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.835941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.836608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.836888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.837161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.837961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] RBAC: Adding query filter params (role.id=65640d9c917344788480a7d50c0694c0, user.id=ad88c252f5a54fa4a42864566516e202, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:51.838273 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:51.839753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:51.856416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 171/331] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/role_assignments?user.id=ad88c252f5a54fa4a42864566516e202&scope.system=all&role.id=65640d9c917344788480a7d50c0694c0 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:51.890352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3e964-f9e6-4cb6-b735-8277d0801825 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:51.936746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:51.937772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:51.938285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:51.938759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:51.939717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:51.940223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:51.941918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:51.952676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 161/332] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:51.959203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:52.082849 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a29f-216c-42f3-97a8-2287590bceda None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:52.118997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:52.119989 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:52.120527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:52.120995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] PATH_INFO: `/v3/users/9554799a15964df1b39f102d80dfdd6b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:52.122404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] RBAC: Authorizing `identity:get_user(user_id=9554799a15964df1b39f102d80dfdd6b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:52.124692 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5621b-ecbd-4872-bd99-8afc25727e0f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:52.126576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 172/333] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:51 2022] GET /identity/v3/users/9554799a15964df1b39f102d80dfdd6b => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:52.133620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:52.144822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:52.242702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199df3-752b-4deb-891f-40f1cef28704 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:52.277287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:52.278010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:52.278296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:52.278574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] PATH_INFO: `/v3/system/users/9554799a15964df1b39f102d80dfdd6b/roles/e405d27a8734458d8f878b2f9da01152` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:52.280618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9554799a15964df1b39f102d80dfdd6b, role_id=e405d27a8734458d8f878b2f9da01152)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:52.281998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c828-b12f-46e2-b06a-37db91441d9b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:52.293454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 162/334] 10.222.0.40 () {58 vars in 1334 bytes} [Sun Jul 31 00:59:52 2022] PUT /identity/v3/system/users/9554799a15964df1b39f102d80dfdd6b/roles/e405d27a8734458d8f878b2f9da01152 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 00:59:53.555427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddbf2a-61e8-4db5-85b8-9bee747f9e6c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:53.555953 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddbf2a-61e8-4db5-85b8-9bee747f9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:53.556232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddbf2a-61e8-4db5-85b8-9bee747f9e6c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:53.558289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 173/335] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:53.569000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c455d-bded-4a78-b833-90527bf5bc2e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:53.569507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c455d-bded-4a78-b833-90527bf5bc2e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:53.569980 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c455d-bded-4a78-b833-90527bf5bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:53.614153 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9f5c455d-bded-4a78-b833-90527bf5bc2e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:53.615744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9f5c455d-bded-4a78-b833-90527bf5bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:53.692875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:53.697720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 163/336] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:53.738465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddbf2a-61e8-4db5-85b8-9bee747f9e6c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:53.752012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:53.822772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97d0f-2537-496e-8d5c-8a8418f19c93 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:53.823077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97d0f-2537-496e-8d5c-8a8418f19c93 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:53.823251 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97d0f-2537-496e-8d5c-8a8418f19c93 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:53.825716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 164/337] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:53.830705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:53.830999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:53.831276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:53.869114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:53.870334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:53.876938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddbf2a-61e8-4db5-85b8-9bee747f9e6c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:53.930282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:53.930955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:53.931240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:53.931517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:53.953837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:53.960058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:53.960968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:53.961747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:53.964235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 174/338] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:53.977491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.000747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 165/339] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:54.043960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.092790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:54.180910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04db05-8e26-492a-83d5-632df9f577ea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:54.264930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15e984-0d03-47b1-8fd0-6074f782d036 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:54.268671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:54.269577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.270182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.271306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.272496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:54.276042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:54.279159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:54.297912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 175/340] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:54.304691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.320649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:54.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:54.339208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.339493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.339770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.358428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:54.364224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:54.365141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:54.365931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:54.366546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 166/341] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 00:59:54.374291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.492141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336878b2-58dd-420b-9cb4-0977518d3d93 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:54.509859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646beb1-438d-4fcf-bf2f-b2b0ddd34806 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:54.552214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:54.558893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:54.559373 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:54.560007 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.560308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.560589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.561115 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.561628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.562102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.563118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:54.563874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:54.565555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:54.576869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 167/342] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:54.584508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.648329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:54.697529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:54.699009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9ff56-bde5-433a-b343-d17aa542644c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:54.745895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b84b-cb8a-46f8-9f5c-97189d82447a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:54.832307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:54.832307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.832307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.832307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.915181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 176/343] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:54.916422 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1eebf-900b-4aac-b024-f605dd7f25ba None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:54.916702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1eebf-900b-4aac-b024-f605dd7f25ba None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:54.916974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1eebf-900b-4aac-b024-f605dd7f25ba None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:54.918506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 177/344] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:54.921541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1eebf-900b-4aac-b024-f605dd7f25ba None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:54.961268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:54.987802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:54.992314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174da9a-88d2-4ac2-8624-5fe8162a63e4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.044377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.061909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1eebf-900b-4aac-b024-f605dd7f25ba None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.112361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 168/345] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 00:59:55.113600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.113895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.114214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.133086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:55.134292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:55.155605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.156441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.156720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.157002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.159494 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.160981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.163207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 178/346] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:54 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.164062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.208243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 169/347] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:55.213060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.316627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.334521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53010ef-b485-4fa5-ba8e-89c0b27221df None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.369840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.370617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.370960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.371326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.377727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.379274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.381256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 170/348] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.382019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.386547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.398276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797035a-594a-4650-899c-d6fd6561c97f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.461095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.461665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.461949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.462230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.469116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.470627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.472437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 179/349] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.473215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.495102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee3f2-4f3b-486b-88ea-9b1777e963d2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.535199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.536057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.536368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.536672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.556873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:55.569953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:55.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:55.571714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:55.578140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 171/350] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:55.580621 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.591824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.625685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29768d89-3b2f-4fe3-84ed-ed867da27a82 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.668050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.669068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.669526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.669940 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.670914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:55.671377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.672844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.679623 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 180/351] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=65640d9c917344788480a7d50c0694c0 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.682499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.708712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9cb5-af68-464a-9872-babc50869a6a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.727193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.751377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.752052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.752396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.753304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.754612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.756174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120d8e-c96b-436e-b4c9-8e627c1813d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.758331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 172/352] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.759705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828003-e690-4621-be79-6c580c362703 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.759998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828003-e690-4621-be79-6c580c362703 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.765254 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94828003-e690-4621-be79-6c580c362703 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.767174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 173/353] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:55.767992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364287-fd0f-4014-88ab-aedb4de22e36 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.768296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364287-fd0f-4014-88ab-aedb4de22e36 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.768637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364287-fd0f-4014-88ab-aedb4de22e36 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.775444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 174/354] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:55.776339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364287-fd0f-4014-88ab-aedb4de22e36 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:55.835898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e02f96-a1a8-4fe6-ba93-93a17fb16a97 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.884816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:55.892734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.893442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.893963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.894227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.895516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:55.896137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.897845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5d0b-98a4-4424-9b35-6b79c6a910fa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.908436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 181/355] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.909676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538400-173d-46fb-9622-8e76387faf6d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.909967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538400-173d-46fb-9622-8e76387faf6d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.910249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538400-173d-46fb-9622-8e76387faf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.928692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364287-fd0f-4014-88ab-aedb4de22e36 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:55.939492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9b538400-173d-46fb-9622-8e76387faf6d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:55.941543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9b538400-173d-46fb-9622-8e76387faf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:55.976178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:55.976833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.977135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.977675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:55.978308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:55.978519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:55.979953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c6c36-7b0e-455b-80b8-0e48b7c7d6aa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:55.986227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 175/356] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 00:59:55 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:55.987118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d027e-e5e8-4efe-a4df-6a4260acb5d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:55.987404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d027e-e5e8-4efe-a4df-6a4260acb5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:55.987678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d027e-e5e8-4efe-a4df-6a4260acb5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.009869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-871d027e-e5e8-4efe-a4df-6a4260acb5d8 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:56.011252 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-871d027e-e5e8-4efe-a4df-6a4260acb5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:56.045642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 182/357] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:56.047476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541576-601a-4ef7-8ade-5008f9ae3051 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.048350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541576-601a-4ef7-8ade-5008f9ae3051 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.048948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541576-601a-4ef7-8ade-5008f9ae3051 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.050978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 183/358] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:56.052419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541576-601a-4ef7-8ade-5008f9ae3051 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.089482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.104048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 176/359] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:56.105764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.106252 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.106723 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.141381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:56.142633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:56.213725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541576-601a-4ef7-8ade-5008f9ae3051 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.253054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 177/360] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 00:59:56.253919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.265606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.267111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.267219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.267458 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.357374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:56.359029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:56.378417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74fcae-c3b7-4307-a34b-b24154728f6c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.388232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.415176 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.415837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.416120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.416451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.428462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:56.437202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:56.438102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:56.438955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:56.439546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 178/361] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:56.440486 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.477814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 184/362] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:56.478895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.551081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.606844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab809d6-d179-4cc4-b656-55d86d73ef02 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.609343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87f7e-e926-4061-a69a-806579b42db1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.639769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.656040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.656751 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.657410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.657675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.657770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.657960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.658206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.658729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.676743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:56.678078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:56.682725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:56.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 00:59:56.684452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:56.685062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:56.687040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 00:59:56.687819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:56.688434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 179/363] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:56.688434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.688577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 185/364] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:56.688577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.800897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4ba8-e842-4ac7-ac34-5fc60d3b8c8f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.804544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f34ee-3e11-4264-9dcf-00790cc71c90 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.820664 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.843369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.844116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.844434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.844737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.845527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:56.845859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:56.846887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:56.847368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:56.847538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:56.847813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:56.848091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:56.849299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:56.850748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:56.852768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 186/365] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:56.853568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.860456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 180/366] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:56.868179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:56.914136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:56.992043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90503980-46d0-4f38-ac4f-c3b46f12a02f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:56.992552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcc85-cb95-488e-84bd-f600daa92ae1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.032702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.033336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.033621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.033894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.034096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.034621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:57.034798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.034943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.035083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.035366 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.036122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:57.036318 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.036500 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.037985 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.050306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 187/367] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.050579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 181/368] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.051266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.051448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.101903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.183836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d05-6724-4c5d-aafb-9c74c454cfb8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.188912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc2715-6274-4224-af5d-7719c63c0d31 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.207112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.227538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.228175 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.228604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.228885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.235775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.236478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.236765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.237043 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.238232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.240277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.242372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 188/369] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.243649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.325589 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.327143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.377232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.391542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf7b8-4ce2-4db1-a737-e512020ef342 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.439911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.440766 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.441538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] PATH_INFO: `/v3/users/9554799a15964df1b39f102d80dfdd6b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.443013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] RBAC: Authorizing `identity:get_user(user_id=9554799a15964df1b39f102d80dfdd6b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.444768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.446828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/users/9554799a15964df1b39f102d80dfdd6b => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.447585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.458555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 182/371] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:57.461260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.517993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.585359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ad70-35c2-406f-907f-3a1c89bab597 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.587905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed81e4-0bd1-46a8-9973-f2ae7e917513 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.635960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.636573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.636855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.637129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.641789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.644583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.645101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.645658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.647065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:57.647507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.649520 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.656760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 183/372] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=65640d9c917344788480a7d50c0694c0 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.657831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.669608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.749117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.751830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.794499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4484-1df1-4ae5-802a-da53ed52158b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:57.809819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.835580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:57.836346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:57.836636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:57.836937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:57.837857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] RBAC: Adding query filter params (role.id=e405d27a8734458d8f878b2f9da01152, user.id=9554799a15964df1b39f102d80dfdd6b, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:57.838210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:57.839840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:57.853207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 184/373] 10.222.0.40 () {56 vars in 1308 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/role_assignments?user.id=9554799a15964df1b39f102d80dfdd6b&scope.system=all&role.id=e405d27a8734458d8f878b2f9da01152 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:57.853963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.918311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 190/374] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 00:59:57.924313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:57.934874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:57.980826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b43-1bde-4f79-81e4-aafd9da3213b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.034859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.035599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.035915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.036199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.040023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.041652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.043595 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 185/375] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:58.051317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.130943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f807c1-67fe-4827-b90d-1f3549277600 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.186711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.187396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.187679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.187952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] PATH_INFO: `/v3/projects/75a7020f93b24515b5df25cc753d8bc8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.189278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] RBAC: Authorizing `identity:get_project(project_id=75a7020f93b24515b5df25cc753d8bc8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.190831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.195782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d2f9-6628-443a-8d56-c4d6831466e9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.196359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 191/376] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:57 2022] GET /identity/v3/projects/75a7020f93b24515b5df25cc753d8bc8 => generated 344 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:58.198440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.229392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:58.233270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:58.239033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.239955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.240445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.240882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.242297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.244552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.246504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 186/377] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:58.253809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.346891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729094-fa51-40de-814a-de2ef5e73f75 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.368544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3519-ccea-4f22-8c31-6762226dfe66 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.402119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.402842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.403050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.403326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] PATH_INFO: `/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.412113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] RBAC: Authorizing `identity:get_group(group_id=9a9396e1184e4f21a2c0660a1791dc0d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.413604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a641-c469-4d27-a657-187bff11dabd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.414534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.415342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.415688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 192/378] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:58.415949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.416237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.417076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:58.417394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.418834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea3752-7ad2-44ba-8cd9-9de5e16c89a8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.422079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e76d-7598-4486-a719-757818dc060b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.422576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e76d-7598-4486-a719-757818dc060b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.423021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e76d-7598-4486-a719-757818dc060b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.427011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 193/379] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:58.427940 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e76d-7598-4486-a719-757818dc060b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.430542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 187/380] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:58.433400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2b3c-2927-41ce-a2a4-1eafe93a8050 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.433609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2b3c-2927-41ce-a2a4-1eafe93a8050 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.433894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2b3c-2927-41ce-a2a4-1eafe93a8050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.469216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-933a2b3c-2927-41ce-a2a4-1eafe93a8050 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:58.470369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-933a2b3c-2927-41ce-a2a4-1eafe93a8050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:58.531009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:58.552408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e76d-7598-4486-a719-757818dc060b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.598680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.599677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.600141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.600629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.601622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] RBAC: Adding query filter params (group.id=9a9396e1184e4f21a2c0660a1791dc0d, role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=75a7020f93b24515b5df25cc753d8bc8) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:58.602119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:58.603758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:58.603873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:58.611596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 194/381] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/role_assignments?group.id=9a9396e1184e4f21a2c0660a1791dc0d&scope.project.id=75a7020f93b24515b5df25cc753d8bc8&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:58.616298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 188/382] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:58.657140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.794635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2912f8-fa2d-40a5-8c38-ba8f227cbae3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:58.798924 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ab468-d42c-4437-9011-a8f58a74ea8f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.799380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ab468-d42c-4437-9011-a8f58a74ea8f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.799476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ab468-d42c-4437-9011-a8f58a74ea8f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.801004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 189/383] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 00:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 00:59:58.807503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.808107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.808425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.829849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 00:59:58.831064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 00:59:58.838770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:58.839961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:58.840245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:58.840544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:58.854902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:58.864705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:58.865701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 00:59:58.866520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 00:59:58.867174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 195/384] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:58.872873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.882710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:58.925180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 190/385] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 00:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 00:59:58.949773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:58.996720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061525f-c1e5-48ef-8488-f688e5820b97 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.041156 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.041446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.041723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.042512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:59.042822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.044466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.055000 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 196/386] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:59.061268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.070275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ed70-8ff5-4928-bb2c-03c231fc1a5c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.097514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:59.113536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.114677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.115183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.115673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.130490 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 00:59:59.136104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 00:59:59.137133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 00:59:59.137926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 00:59:59.141175 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 191/387] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 00:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 00:59:59.147697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.175183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:59.217514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b4698-e783-4625-bad0-c11a30499789 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.284381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.285477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.286035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.286557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.287801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1effd-f3fb-4a83-938d-95fe730b338e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.290763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.293444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.295895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 197/388] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:59 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:59.302161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.344070 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.345142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.345649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.346127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.349870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 00:59:59.350789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.352437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.362840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 192/389] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 00:59:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:59.368891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.450944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:59.506952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e30a5-5bc4-411d-81d8-93fd42e4976e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.554247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c56f-0c48-4b8e-916a-7e275a014c07 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.571189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.572327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.572875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.573381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.574898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.577259 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.579585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 198/390] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:59 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 00:59:59.586267 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.600716 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:59.611087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.611853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.612137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.612447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.614285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.615725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.617743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 193/391] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 00:59:59 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:59.624222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.786818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533014-2834-4707-a432-f57feb8c55bb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.790380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c63a-0611-4514-9587-c42fba8396c6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 00:59:59.801442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:59:59.835156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.836181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.836683 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.837139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.839162 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.841801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.845403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 194/392] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 00:59:59 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 00:59:59.851863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 00:59:59.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 00:59:59.906305 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 00:59:59.906587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 00:59:59.906931 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/groups/c8203da0f4ec406a95fc0379573b06bd/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 00:59:59.913196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, group_id=c8203da0f4ec406a95fc0379573b06bd, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 00:59:59.914752 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012eee1c-6a4e-4228-8fa9-0e8da221e25c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 00:59:59.936516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 199/393] 10.222.0.40 () {58 vars in 1442 bytes} [Sun Jul 31 00:59:59 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/groups/c8203da0f4ec406a95fc0379573b06bd/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 00:59:59.981742 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c372a3a-9ba9-4362-846d-08cc8bf68c2a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:00.032650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:00.033349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:00.033637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:00.033917 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/groups/c8203da0f4ec406a95fc0379573b06bd/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:00.036407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0, group_id=c8203da0f4ec406a95fc0379573b06bd, role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:00.038011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e3806-8915-4b61-a207-099576cc7cac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:00.054520 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 195/394] 10.222.0.40 () {58 vars in 1442 bytes} [Sun Jul 31 00:59:59 2022] PUT /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0/groups/c8203da0f4ec406a95fc0379573b06bd/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:00.724112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fca0-9fa0-406a-8dce-0ae722aa5892 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:00.724495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fca0-9fa0-406a-8dce-0ae722aa5892 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:00.724702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fca0-9fa0-406a-8dce-0ae722aa5892 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:00.726211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 200/395] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:00.735711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:00.735711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:00.735711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:00.766320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:00.767873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:00.855913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:00.933948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 196/396] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:01.008451 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5fca0-9fa0-406a-8dce-0ae722aa5892 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.093126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:01.142594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5fca0-9fa0-406a-8dce-0ae722aa5892 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.177681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.178332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.178611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.178882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.190699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2725af43-a87c-42ec-8fee-6496a3e00a24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:01.196188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:01.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:01.197908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 201/397] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:01.203901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.319232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5482e-4208-4ffc-8bc9-7e3329a98163 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.331994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef784e-afcf-4c2e-a2b3-d14378a205d1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.332343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef784e-afcf-4c2e-a2b3-d14378a205d1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.332545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef784e-afcf-4c2e-a2b3-d14378a205d1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.333895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 202/398] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:01.340464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6573-a4d5-4938-863d-dab154f2eb54 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.340755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6573-a4d5-4938-863d-dab154f2eb54 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.341038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e6573-a4d5-4938-863d-dab154f2eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.366282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.366919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.367198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.367471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.368203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:01.368532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:01.370220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:01.377349 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-343e6573-a4d5-4938-863d-dab154f2eb54 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:01.378592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-343e6573-a4d5-4938-863d-dab154f2eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:01.381302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 197/399] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:01.389406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.433215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:01.512172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 203/400] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:01.513656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d642c-b9b1-45cd-b261-0da342991222 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d642c-b9b1-45cd-b261-0da342991222 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.514473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d642c-b9b1-45cd-b261-0da342991222 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.515785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 204/401] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:01.521018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97feb2-5621-4996-8902-56be08910699 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.521309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97feb2-5621-4996-8902-56be08910699 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.521592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97feb2-5621-4996-8902-56be08910699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.523347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777fff1-a107-4be3-86d6-6d3747f92ab3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.541005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-af97feb2-5621-4996-8902-56be08910699 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:01.542217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-af97feb2-5621-4996-8902-56be08910699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:01.570130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.571365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.572236 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.573004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.574690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:01.577058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:01.579434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 198/402] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:01.580705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.598279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:01.624620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 205/403] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:01.625731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97feb2-5621-4996-8902-56be08910699 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.706437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0497-d6d7-4b8e-bc91-217f5580b76f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.708689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:01.753771 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.754515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.755027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.755307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.757725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97feb2-5621-4996-8902-56be08910699 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.768766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:01.775987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:01.777123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:01.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:01.780854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 199/404] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:01.782093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.802852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.803486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.803876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.804246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.805559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:01.807429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:01.811130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 206/405] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:01.812183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:01.884805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:01.930391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2bcc-b7ab-4f02-b53d-a6c5c5f313ae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.944876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf863fb-4d2b-4eba-8af9-ee26ce2238c6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:01.971675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.972573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.972802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.985825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:01.988739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:01.989560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:01.989996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:01.990414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:01.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:01.991722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:01.993283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:01.993676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:01.994712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 200/406] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:01.995813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.007997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 207/407] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.009140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.029988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.124957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04376e-0ba4-4e08-a330-b32f20885cb1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.125400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0efa40-bb91-4e50-82d8-365998dcdfbe None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.139986 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.162032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.162661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.162942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.163219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.163933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:02.164240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.165790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.172292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.173224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.173743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.174230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/groups/c8203da0f4ec406a95fc0379573b06bd/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.179530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 208/408] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.179530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.181466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, group_id=c8203da0f4ec406a95fc0379573b06bd, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.183433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.200556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 201/409] 10.222.0.40 () {58 vars in 1442 bytes} [Sun Jul 31 01:00:01 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/groups/c8203da0f4ec406a95fc0379573b06bd/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:02.201902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.297727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.318268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be271f8-3f3b-4229-9314-db1070eacdd5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.340690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4d00-b4a8-4c8d-97f1-06685f6a8307 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.355135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.356295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.356774 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.357239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] PATH_INFO: `/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.359160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] RBAC: Authorizing `identity:get_group(group_id=9a9396e1184e4f21a2c0660a1791dc0d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.360995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.362917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 209/410] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:02 2022] GET /identity/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.368715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.415373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.421135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.421634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.423245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.426458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.432887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 202/411] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:02 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.437336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.476183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.552789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea62c-710a-4fcf-8570-0e6603e9ad6b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.568014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d1d94-4713-4a83-99c4-1f2957becb3c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.604317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.605263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.605557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.605841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] PATH_INFO: `/v3/projects/75a7020f93b24515b5df25cc753d8bc8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.607206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] RBAC: Authorizing `identity:get_project(project_id=75a7020f93b24515b5df25cc753d8bc8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.609381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.611466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 210/412] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:02 2022] GET /identity/v3/projects/75a7020f93b24515b5df25cc753d8bc8 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.613249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.614120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.614593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.615075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.616813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.618438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.620314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 203/413] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:02 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:02.626800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.627860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:02.668713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.808319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cedadb-fa52-474f-b19c-a4a7653487cf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.827386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:02.854069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff0414-f552-4bc5-9740-2a3341caa444 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:02.869259 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.871117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.871608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.872374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] PATH_INFO: `/v3/projects/75a7020f93b24515b5df25cc753d8bc8/groups/9a9396e1184e4f21a2c0660a1791dc0d/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.875010 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] RBAC: Authorizing `identity:create_grant(project_id=75a7020f93b24515b5df25cc753d8bc8, group_id=9a9396e1184e4f21a2c0660a1791dc0d, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.877383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604174b-cdcd-4a87-b98e-a0b96253cc54 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.893274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:02.894516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.895108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.895601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/groups/c8203da0f4ec406a95fc0379573b06bd/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.903927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=62c89654e94b40f9a5eaab0c35e89d3c, group_id=c8203da0f4ec406a95fc0379573b06bd, role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:02.903927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5c953-d9e4-4c4a-b7d0-8cfce3cb1a4c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:02.904426 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 211/414] 10.222.0.40 () {58 vars in 1442 bytes} [Sun Jul 31 01:00:02 2022] PUT /identity/v3/projects/75a7020f93b24515b5df25cc753d8bc8/groups/9a9396e1184e4f21a2c0660a1791dc0d/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:02.907331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6967-a49b-4bb0-8afc-3d4a33efd101 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.907556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6967-a49b-4bb0-8afc-3d4a33efd101 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.907898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6967-a49b-4bb0-8afc-3d4a33efd101 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.913746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 212/415] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:02.915704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.916007 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.916362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.926832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 204/416] 10.222.0.40 () {58 vars in 1442 bytes} [Sun Jul 31 01:00:02 2022] PUT /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c/groups/c8203da0f4ec406a95fc0379573b06bd/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:02.942443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:02.943820 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:02.994105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1734e-b0f9-4ed8-9c63-e198ba5d4b09 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:02.995844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1734e-b0f9-4ed8-9c63-e198ba5d4b09 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:02.996403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1734e-b0f9-4ed8-9c63-e198ba5d4b09 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:02.999320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 205/417] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:03.006231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.006426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.006679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.053521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:03.055114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:03.073863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 213/418] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:03.113596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.152293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 206/419] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:03.181212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.194489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:03.266538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586f4a-cdc5-44fc-804a-a18d08426688 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:03.268691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:03.321910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206c0c4-1914-4cb1-aa61-8c443cd2b043 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:03.331733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:03.332477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.332817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.349512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:03.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:03.355469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:03.356290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:03.358663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 214/420] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:03.365211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.408715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:03.409382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.409662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.409937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.435084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:03.440203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:03.441120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:03.441896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:03.442640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 207/421] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:03.453226 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.503461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2180-6eff-48af-b4d4-0abedd24b94c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:03.541686 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:03.542449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.542798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.543141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:03.544440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:03.546164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:03.555139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 215/422] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:03.561432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.591782 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:03.631182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:03.697073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622fca5-de97-4b08-b4bc-a63560df50e1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:03.738542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f230-b1c4-4460-a781-ad3ef5f39702 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:03.766711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:03.767351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.767635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.767913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.768671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:03.768977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:03.770371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:03.787282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 208/423] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:03.794198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:03.810035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:03.810738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:03.811026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:03.811302 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:03.936723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:03.938330 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:03.971218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43181d-a165-4c92-a4be-e4051669c9be None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.003444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.012591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.021569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.022438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.023088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.024549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.126478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 216/424] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:00:04.128434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.136277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.136277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.258548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 209/425] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:04.265263 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.273274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30451-60bd-4079-ac48-55e8d305f6a7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.299843 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.318980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.319654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.319933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.320205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.322002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.323442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.328355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 217/426] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:04.332735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.333188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.490365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255e98-a96e-4e99-8976-66837ba34d8e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.501883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea264c0-d5ec-4f3e-9f6a-5173292c26ea None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.568088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.568753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.569052 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.569379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.572064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.575431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.579179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.579847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.580130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.580431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] PATH_INFO: `/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.581618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] RBAC: Authorizing `identity:get_project(project_id=0ac8c86d70d44f6ab90e65163b5cb2d0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.583240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 218/427] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:04.583362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.585955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.588947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 210/428] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/projects/0ac8c86d70d44f6ab90e65163b5cb2d0 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:04.591477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.656681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.697894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dccfb-6f86-45ac-9390-369fdfcc607f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.737228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.738258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.738663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.738952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.740104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:04.740606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.742747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa48bc-facf-47b9-aeb0-64044aec8334 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.751560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 219/429] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:04.752912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f33a-7616-4834-9c50-bfd5087d5bbd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.753207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f33a-7616-4834-9c50-bfd5087d5bbd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.753493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f33a-7616-4834-9c50-bfd5087d5bbd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.754816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 220/430] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:04.761832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.762123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.762401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.783463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:04.784716 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:04.867488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:04.874398 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c10fc-8f18-4ef3-9815-b3b27fc9e12c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:04.906197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 221/431] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:04.945851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:04.954173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:04.954840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:04.955105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:04.955381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:04.956775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:04.958227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:04.960166 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 211/432] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:04.966263 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.013240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.072629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb55d2-fb5c-430a-8179-a41afb0ee7cf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.106893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe41a-6ac5-4023-a276-fa432f691bb1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.112531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.113184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.113465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.113740 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.126439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:05.131794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:05.133111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:05.133895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 222/433] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:05.140461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.154954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.155944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.156465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.157045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.158152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:05.158679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:05.160543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f1da-9006-4997-941d-b34096cbcef4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:05.167446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 212/434] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 01:00:04 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=0ac8c86d70d44f6ab90e65163b5cb2d0&role.id=65640d9c917344788480a7d50c0694c0 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:05.258837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485345c-cdd8-4814-86ba-6eaa4e487937 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.275391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.298167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.298820 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.299105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.299382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.300121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:05.300460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:05.301953 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:05.311957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 223/435] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:05.312519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4b2c-3f34-4c68-a39f-01cdf1d807b5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.312814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4b2c-3f34-4c68-a39f-01cdf1d807b5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.313096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4b2c-3f34-4c68-a39f-01cdf1d807b5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.314691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 213/436] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:05.317854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.320154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.320474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.320762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.342488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:05.343743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:05.372860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.431921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 214/437] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:05.440551 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14e8a-1d91-44e3-b480-48e6664d18a7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.456049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.484395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.485064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.485320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.485600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.538702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.566107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:05.567579 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8c53b-b43b-49dd-973f-2840dcd63994 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:05.582913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06343673-0e14-454f-b1e6-e1913e1f945f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.625600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.626266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.626546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.627262 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.640569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0b3514f9-3c13-44cf-9d2b-f1c1e0f1127b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:05.645714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:05.646593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:05.647414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 215/438] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:05.649404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d71cc-2cfc-4589-a68d-4596150f5494 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.649404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d71cc-2cfc-4589-a68d-4596150f5494 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.649404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d71cc-2cfc-4589-a68d-4596150f5494 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.650505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 216/439] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:05.652910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d71cc-2cfc-4589-a68d-4596150f5494 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.678087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.689617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 224/440] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:05.691079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.691364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.691638 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.714493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:05.715505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:05.779772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d71cc-2cfc-4589-a68d-4596150f5494 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.796762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 225/441] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:05.801123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.810250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.825422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.826091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.826382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.826662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.827390 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:05.827707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:05.829144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:05.837795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 217/442] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:05.838508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.908682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67865016-e1d8-475e-80a2-a2795de4c5b6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.923015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:05.942508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e29d-03ea-42ba-ae9c-e1fa46f71721 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:05.944599 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.945324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.945611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.945885 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.947041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:05.948540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:05.950195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 226/443] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:05.950947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:05.978695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:05.979344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:05.979633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:05.979916 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:05.990051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:05.996099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:05.997109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:05.997919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 218/444] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:05.998587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.032121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.058850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fc599-0443-47d5-9d65-57f8c5e6a648 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.096951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.097568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.097858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.098131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.099589 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1de7b-2e3a-41e4-b0ec-38a232a5cacf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.135158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.135851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.136428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.136428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.137558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.139652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.141301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 219/445] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:06.142063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.155468 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.168901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.170926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.243543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.244082 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c952e7d-2c41-4485-a04f-57fb7f4d1675 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.270022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 227/446] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:06.270998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.279454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.280080 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.280395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.280676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.281403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:06.281711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.283078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.291132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 220/447] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:06.292099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.368386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.377289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10bc1-33c5-4e62-96e8-6bd9e9a8b0b5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.399286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb236-e536-48f5-849f-1f642511645e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.411020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.411649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.412208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.413042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=65640d9c917344788480a7d50c0694c0, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:06.413354 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.414789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.420536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 228/448] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=65640d9c917344788480a7d50c0694c0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:06.421327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.434625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.436172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.436649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.436932 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] PATH_INFO: `/v3/projects/75a7020f93b24515b5df25cc753d8bc8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.438253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] RBAC: Authorizing `identity:get_project(project_id=75a7020f93b24515b5df25cc753d8bc8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.439735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.441725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 221/449] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/projects/75a7020f93b24515b5df25cc753d8bc8 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:06.447325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.468538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.546024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205f8c-f760-4061-8920-1859c2a568fb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.562085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb250448-4881-4e3f-96df-76f4206b1c33 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.595772 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.596436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.596721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.597001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.608409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.609042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.609323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.609596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] PATH_INFO: `/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.610835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] RBAC: Authorizing `identity:get_group(group_id=9a9396e1184e4f21a2c0660a1791dc0d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.612437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.613907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/groups/9a9396e1184e4f21a2c0660a1791dc0d => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:06.620835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.635159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.681336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.684164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.729614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.734050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93fd0f-8c1f-4b0e-afb4-14ba4f3b9b76 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.771730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.772501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.775346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.775346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.775346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] RBAC: Adding query filter params (group.id=9a9396e1184e4f21a2c0660a1791dc0d, role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=75a7020f93b24515b5df25cc753d8bc8) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:06.775346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.775753 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.783308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 223/451] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/role_assignments?group.id=9a9396e1184e4f21a2c0660a1791dc0d&scope.project.id=75a7020f93b24515b5df25cc753d8bc8&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:06.809826 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 229/452] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:06.816617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:06.895488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:06.930757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1472f0-1ef5-43b4-b901-95eac442253a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:06.966928 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:06.967587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:06.967869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:06.968141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] PATH_INFO: `/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:06.969381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] RBAC: Authorizing `identity:get_project(project_id=62c89654e94b40f9a5eaab0c35e89d3c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:06.970816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:06.972503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 224/453] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/projects/62c89654e94b40f9a5eaab0c35e89d3c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:06.978212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:07.073763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e0370-0379-44fa-abd1-eb5f3314833b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:07.109672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:07.113893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:07.114174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:07.114448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] PATH_INFO: `/v3/groups/c8203da0f4ec406a95fc0379573b06bd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:07.116640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] RBAC: Authorizing `identity:get_group(group_id=c8203da0f4ec406a95fc0379573b06bd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:07.118099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4006c-5919-4db4-a7f3-761527d388bc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:07.119735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 230/454] 10.222.0.40 () {56 vars in 1180 bytes} [Sun Jul 31 01:00:06 2022] GET /identity/v3/groups/c8203da0f4ec406a95fc0379573b06bd => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:07.128985 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:07.223937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b4f37-bbe4-4f8d-914e-53be967c38de None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:07.255404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:07.256062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:07.256372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:07.256647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:07.257422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] RBAC: Adding query filter params (group.id=c8203da0f4ec406a95fc0379573b06bd, role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:07.257728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:07.259136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e05d5-85ed-4e51-a4a9-0be8a93acd01 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:07.264732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 225/455] 10.222.0.40 () {56 vars in 1376 bytes} [Sun Jul 31 01:00:07 2022] GET /identity/v3/role_assignments?group.id=c8203da0f4ec406a95fc0379573b06bd&scope.project.id=62c89654e94b40f9a5eaab0c35e89d3c&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:09.853439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925efc-da9d-4b26-b2a3-6593428ac597 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:09.853953 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925efc-da9d-4b26-b2a3-6593428ac597 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:09.854026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925efc-da9d-4b26-b2a3-6593428ac597 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:09.855615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 231/456] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:09.871243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abdfe-f323-4413-9671-744b39b69de3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:09.871880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abdfe-f323-4413-9671-744b39b69de3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:09.871880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abdfe-f323-4413-9671-744b39b69de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:09.885080 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:09.900462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-522abdfe-f323-4413-9671-744b39b69de3 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:09.901687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-522abdfe-f323-4413-9671-744b39b69de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:09.996651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 226/457] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:10.040442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925efc-da9d-4b26-b2a3-6593428ac597 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.054709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.213068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58481-5f4e-4be1-8b7f-d067cc852c48 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.213419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58481-5f4e-4be1-8b7f-d067cc852c48 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.213706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58481-5f4e-4be1-8b7f-d067cc852c48 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.215210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 227/458] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:10.218666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925efc-da9d-4b26-b2a3-6593428ac597 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.221241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744066-0884-4367-8a7e-a8d61d716dda None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.221871 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744066-0884-4367-8a7e-a8d61d716dda None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.222344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b744066-0884-4367-8a7e-a8d61d716dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.244463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4b744066-0884-4367-8a7e-a8d61d716dda None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:10.245991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4b744066-0884-4367-8a7e-a8d61d716dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:10.272047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.273326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.273804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.274513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.289615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.291384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e8c38411-b05c-49f8-a857-92f49a58e9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:10.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:10.315544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:10.316401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:10.316401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:10.316401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.316401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:10.317759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 232/459] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:10.319543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a15ae-09f8-46fb-91e6-76c6a203a9b6 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.319822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a15ae-09f8-46fb-91e6-76c6a203a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.320097 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a15ae-09f8-46fb-91e6-76c6a203a9b6 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.322285 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 233/460] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:10.323392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a15ae-09f8-46fb-91e6-76c6a203a9b6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.327044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 228/461] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:10.328572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.328996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.329427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.357805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:10.361016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:10.406730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.430388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.441174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 229/462] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:10.442215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.455175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a15ae-09f8-46fb-91e6-76c6a203a9b6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.491569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.492587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.493100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.493610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.494516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:10.495075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.496791 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.516212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 234/463] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:10.517602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b537-5795-45b5-81fd-41004970aa67 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.595588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.596734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.596734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.596931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.607977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.609608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:10.626178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:10.627090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:10.627944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:10.627944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:10.627944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.627944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:10.630916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbc6c2-4314-4f06-9244-c1a0c087270a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.632122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 230/464] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:10.633137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.651085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.670381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.671407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.671896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.672409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.684015 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.685946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.687807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:10.704403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:10.705296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:10.706146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:10.706146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:10.706146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:10.706146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:10.708338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 235/465] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:10.709559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.747912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f75ac-e611-4bb8-a351-e8d8fb4c8455 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.784171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.784817 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.785098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.786068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.786068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.787484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.808634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 231/466] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:10 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:10.809453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:10.826700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae40d-9462-4923-b44c-ad1353161f78 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.870016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:10.871588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.872215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.872871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.873830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:10.874353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:10.876308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff0032-7365-4b50-95fd-814891880027 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:10.893803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 236/467] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:10.895586 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564ce0-49b6-43d1-823d-6480f4497445 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.896182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564ce0-49b6-43d1-823d-6480f4497445 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.896700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564ce0-49b6-43d1-823d-6480f4497445 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.898770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 237/468] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:10.904681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b360d5-56a9-4533-96d1-cc868cdee8d6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:10.904975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b360d5-56a9-4533-96d1-cc868cdee8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:10.905258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b360d5-56a9-4533-96d1-cc868cdee8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:10.926184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f6b360d5-56a9-4533-96d1-cc868cdee8d6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:10.927441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f6b360d5-56a9-4533-96d1-cc868cdee8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:10.946405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e9a8-fa9e-4b52-b20e-f83caa99a771 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:10.949262 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:10.958718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:11.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.001687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.001982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.002731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.003880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:11.004000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.005625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.020434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 232/469] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:11.021279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.022207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 238/470] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:11.025492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135128-92e4-474b-9559-af6828e36702 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.025788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135128-92e4-474b-9559-af6828e36702 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.026072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135128-92e4-474b-9559-af6828e36702 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.027668 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 239/471] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:11.029517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8135128-92e4-474b-9559-af6828e36702 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.146941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4115-6c95-4aff-94c1-93f3d312716b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.152377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8135128-92e4-474b-9559-af6828e36702 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.182834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.183382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.183843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.183957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.184644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.186146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b39e-338b-4c22-83e1-74bd161302eb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.188969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.189431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.189789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.190141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.190955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.192500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.210725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 233/472] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:11 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:11.211972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.212286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.212605 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.217569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 240/473] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:11 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:00:11.219718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.253678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:11.256574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:11.274834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:11.287322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:11.405012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 234/474] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:11.431328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11600-fde4-4520-8b4b-e2a894c6567e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.434634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.470274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.470946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.471230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.471510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.488464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.489972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:11.509051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:11.509970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:11.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:11.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:11.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:11.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:11.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 241/475] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:11.518126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.573940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78e8f-5a46-41fc-95c9-e0526b622109 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.610242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:11.616383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.617087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.617378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.617661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.618395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.619821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.629568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.sql.core [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:00:11.629568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:00:11.629568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [parameters: {'id': 'dda19599000a47a48fbf3460b8172e42', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:00:11.629568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80327) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:00:11.652838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0191ca-3a5c-460f-b17b-ebd4bf1f833c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:00:11.653598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return ref.to_dict() Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:00:11.655481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application yield resource Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise self.value Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application session.commit() Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:00:11.656840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:00:11.657720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:00:11.658561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:00:11.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [parameters: {'id': 'dda19599000a47a48fbf3460b8172e42', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:11.660127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:00:11.667389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.669330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 235/476] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Jul 31 01:00:11 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:11.669330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.708731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:11.743877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.744682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.744975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.745275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.746180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:11.746553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:11.747978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:11.774381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 242/477] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:11.780675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.789578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4271b-90b1-4d1b-8566-ada79216cd19 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:11.827726 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:11.828901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:11.829208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:11.829497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:11.842120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:11.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:11.849581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:00:11.850365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:11.850949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 236/478] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:11.856105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:11.964717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:12.019867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc57bf-6d5d-4f07-b977-06877374045e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:12.031168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b585-69ad-4301-9efb-2c16c99ef6d0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:12.057706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:12.058473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:12.058860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:12.059210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:12.060012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:12.060976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:12.062457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9f00-1c68-4166-aadd-4977f44f3a77 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:12.075775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 237/479] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:12.087965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:12.102775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:12.103425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:12.103711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:12.103993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:12.104724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:12.106235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5495597-09aa-4fd7-9cd4-0b7b1b945273 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:12.142546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 243/480] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:11 2022] POST /identity/v3/users => generated 249 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:00:13.458331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c8109-aa0d-4e13-854d-71b29adafdd3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.458870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c8109-aa0d-4e13-854d-71b29adafdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.458870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c8109-aa0d-4e13-854d-71b29adafdd3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.460548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 238/481] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:13.465643 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e9d4-66a2-4751-a4e7-35f1f731f730 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.466060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e9d4-66a2-4751-a4e7-35f1f731f730 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.466223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e9d4-66a2-4751-a4e7-35f1f731f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.489307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6382e9d4-66a2-4751-a4e7-35f1f731f730 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:13.490844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6382e9d4-66a2-4751-a4e7-35f1f731f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:13.580353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 244/482] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:13.603249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c8109-aa0d-4e13-854d-71b29adafdd3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:13.667761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9035-2073-4fc3-8b19-ca531314c787 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.668107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9035-2073-4fc3-8b19-ca531314c787 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.668341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9035-2073-4fc3-8b19-ca531314c787 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.670346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 245/483] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:13.676811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34115d-f41c-4bc4-a0d7-d88e8e22adbb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.677364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34115d-f41c-4bc4-a0d7-d88e8e22adbb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.677865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34115d-f41c-4bc4-a0d7-d88e8e22adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.708637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bd34115d-f41c-4bc4-a0d7-d88e8e22adbb None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:13.710274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bd34115d-f41c-4bc4-a0d7-d88e8e22adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:13.780784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c8109-aa0d-4e13-854d-71b29adafdd3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:13.837106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:13.837866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.838155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.838437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.839252 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 246/484] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:13.840447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:13.840609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead3b3-49fb-484e-a3a2-a32734d984a8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.840843 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead3b3-49fb-484e-a3a2-a32734d984a8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.841136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead3b3-49fb-484e-a3a2-a32734d984a8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.843777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 247/485] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:13.849750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:13.850040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:13.850372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:13.853257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:13.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:13.862139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:13.863127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:13.866268 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 239/486] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:13.872441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:13.880871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:13.882179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:13.930825 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:13.972531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 248/487] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:13.973342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:13.994800 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460434c-12cf-4628-a843-2c2f551b479c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.033312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.034325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.034905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.035374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.036383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:14.037009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.038708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.048840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 240/488] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:14.050023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.117317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.132545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6242-f0eb-43c8-a6aa-a4c2b18290c6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.172520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.173134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.173417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.173693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.183213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508d1f9-f252-415f-840c-5f6c034cdc4d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.184980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:14.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:14.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 249/489] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.192720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.234216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.235426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.237004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.238222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.238771 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.252112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:14.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:14.260185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:14.264591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 241/490] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.265456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.332180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036bac7-d874-4eba-a589-0b57ea5526c8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.378968 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840b945-0971-4bca-b4ac-5831c64e365e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.379886 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.381063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.381538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.382939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.397571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.399247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.401150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.417892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.418609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.419016 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.419422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.420840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:14.421218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.422738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:14.423476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.424309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.425142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:14.425142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:14.425142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.425142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:14.430420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 250/491] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.431084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.434546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 242/492] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:14.444387 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.532209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.550613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c83d2-59b8-476f-9901-c174921a96cc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.589649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.590599 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.591086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.591673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.592103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad084-62bf-40ca-b6c7-95924d143e7d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.593232 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:14.593719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.595276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.604184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 251/493] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:14.605290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.635981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.637064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.637360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.637642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.639181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:14.639504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.641594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.660374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 243/494] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:14.660374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.718114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.726053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70779ae-ee0f-44c3-80aa-df95f77472e3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.765413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.766238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.766654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.767054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.779776 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.781319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.790312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.795807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70ae9-c338-41b4-a399-4534d5121600 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:14.799628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.800707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.801659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:14.801659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:14.801659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.801659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:14.801659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 252/495] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.802147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.834375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.835012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.835295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.835570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.845982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.847482 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9f07a39b-8fe0-4d36-bb39-c221415851c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:14.862339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.863170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:14.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:14.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:14.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:14.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 244/496] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.865039 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2b05-d98c-4852-881a-7909d81a1f14 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.865760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2b05-d98c-4852-881a-7909d81a1f14 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.865864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b2b05-d98c-4852-881a-7909d81a1f14 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.867220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 245/497] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:14.868106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037f6e-d2a0-4a4c-be31-21f6dac2f5f2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.868419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037f6e-d2a0-4a4c-be31-21f6dac2f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.868698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1037f6e-d2a0-4a4c-be31-21f6dac2f5f2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.870625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 246/498] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:14.870625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1037f6e-d2a0-4a4c-be31-21f6dac2f5f2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.908236 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43a6d-d33d-4ac0-803f-ed5c3d7f40ba None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:14.942482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:14.943127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:14.943409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:14.943687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:14.951173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:14.952674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:14.962567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:14.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:14.966075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:14.966995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:14.970923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 253/499] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:14.971693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:14.974311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1037f6e-d2a0-4a4c-be31-21f6dac2f5f2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.009395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.010026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.010301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.010576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.011273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.011578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.012995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0765dd8-63c4-4ee8-8130-94f6df142088 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.024581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 247/500] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.025805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a1400-48f4-46bb-bbac-f1d0f73dce5c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.026095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a1400-48f4-46bb-bbac-f1d0f73dce5c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.026376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a1400-48f4-46bb-bbac-f1d0f73dce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.030436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.043956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9f1a1400-48f4-46bb-bbac-f1d0f73dce5c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:15.045702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9f1a1400-48f4-46bb-bbac-f1d0f73dce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:15.074115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56ce51-05eb-4141-bcbc-82fac0c32491 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.106468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.107624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.107877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.108147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.108883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.109192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.110581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.114214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 248/501] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:15.115693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.115989 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.116292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.123481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 254/502] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.124327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.146454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:15.147659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:15.214781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 249/503] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:15.215714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.226853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.236103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04773-cbc8-40db-8353-bdc0d17f8d33 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.258023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.272665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.273286 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.273564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.273844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.274637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.274942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.276396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.313121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 255/504] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.313873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.316190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc5bb0-278d-4fb0-aa65-58d0caaaeaa2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.349605 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.350246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.350526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.350807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.357995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.359442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:15.373298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:15.374170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:15.375031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 250/505] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:15.375583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.416678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e255ec-0230-461f-aa6e-cdc8a245c5ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.444612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.452411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.453064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.453354 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.453634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.460743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.462211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:15.474256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:15.475165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:15.479645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:15.480280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3bace-a86e-495d-968c-989f74c12e01 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.480370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 256/506] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:15.480370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.512324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.512975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.513971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.514279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.516995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.525879 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:15.531270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:15.532193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 251/507] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:15.533860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.581488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ec33-806e-4f66-802d-cf7d9640a80d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.616645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.617298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.617585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.628905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.630359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.635868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f58c-4a4a-4704-a087-1d90436b34b2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:15.646099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:15.646969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:15.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:15.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:15.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:15.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:15.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 257/508] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:15.648484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.667791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.674619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.675246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.675535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.675813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.739738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.744105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.745614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.750363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b88d-801e-4748-bdfd-d71f5f711e3d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.783533 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.784155 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.784472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.784755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.785562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.785971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.787409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.804566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 258/509] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.805367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.849149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 252/510] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:15.849908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.879191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.908770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a755-51e9-4c02-953d-2e1234c911d9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.943875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.944529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.944812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.945091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.945917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.946229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.947672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.950734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98655fe-55bc-498d-88c1-26cd6824c8c8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:15.964464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 259/511] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.965380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:15.973567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:15.986383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:15.987011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:15.987296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:15.987571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:15.988314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:15.988621 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:15.989988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:15.998397 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 253/512] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:15.999190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.064919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916613-d33e-4805-b562-5704b12cc244 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.090300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.099242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.099797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.099893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb24c4-076f-4200-be21-2f6c888463e8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.100079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.100384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.101081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:16.101416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.102789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.114842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 260/513] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:16.115660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.140815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.141343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.141628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.141904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.189006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.212311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.214213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.224954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754123f-f9bb-413c-be88-d9c6061b98ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.258363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.259016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.259303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.259582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.270788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.272265 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:16.286680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:16.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 261/514] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:16.288629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.306770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.318662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 254/515] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:16.319510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.397493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955eaf8-5ca0-4224-994e-9fb7299501ed None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.414172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.418978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ff7c-08d5-4999-adde-fa237103cc6b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.433366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.433644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.433919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.455352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.455990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.456301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.456583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.466287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.467750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:16.482521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:16.483518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 255/516] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:16.484585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.503648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.505164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.530783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.586090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b1f47-609a-4d20-a325-7c808d4ff691 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.603514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 262/517] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:16.604194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.623242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.625670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.626560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.626560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.626847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.629009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.650763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 256/518] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:16 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:16.651529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.726126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fb89b-2e93-411a-949c-f53d5d401072 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.762846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.766820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781b2-9138-4b11-9c84-51043b62fc4c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.768691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.769366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.769678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.769904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.770987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:16.770987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.772584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.786584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 263/519] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:16.787312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.808969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.809635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.811043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.811043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.822765 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.824211 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:16.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:16.842883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:16.843711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:16.843711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:16.843711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:16.843711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:16.843711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 257/520] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:16.843972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.883541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:16.907064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947c15-fbb6-41d6-a076-ce2cb836b563 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.943349 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.944065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.944446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:16.944722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:16.945428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:16.945724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:16.947120 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:16.956932 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa07a-3a8d-4fed-a702-c9c4c5938d1c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:16.963817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 264/521] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:16.963817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:16.998598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:16.999354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:16.999764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.000007 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.011167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.012690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:17.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:17.029691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:17.030548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:17.030548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:17.030548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:17.030548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:17.030548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 258/522] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:17.030829 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.038327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.077603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370cd3-12e8-4ca4-a9b0-fb8384140642 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.119983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.120811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.121098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.121386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.129197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.131034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.134960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.150964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c99a8f-806b-4998-9af0-fc7b663b64f9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:17.159124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:17.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:17.168699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 265/523] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:17.170255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.190701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.191399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.191683 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.192013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.192758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.193071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.212132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 259/524] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.212132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.275043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.300266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ee40b-35ab-4664-b3f4-e66a3861069c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaace-fa7b-4ed7-81fa-53b07ab967d4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.337170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.337876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.338100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.338371 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.346570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.348061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.358232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.358861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.359147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.359425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.360130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:17.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:17.361085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:17.362123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:17.362711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.362779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 266/525] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:17.362779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.366347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.380076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 260/526] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.380802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.434071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.479711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4082-e8cb-4c08-b750-2dc64803c140 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.490565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36838-74b7-4b95-88a4-ec89c217c56e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.515577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.520012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.520567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.520937 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.521201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.521893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.522209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.523656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.527781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.528454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.529253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.529553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.536469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.537901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.548304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 267/527] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.548304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:17.561491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:17.562538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 261/528] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:17.566177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.668964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2f36-97fe-4278-b9b0-bf46f73404ba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.669742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5f50-9268-4967-91e8-a8cf10bdbb7e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.689242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.705714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.706522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.706908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.707284 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.708230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.708887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.709172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.709575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.710486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.710814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.712308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.715354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.717538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:17.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:17.730413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:17.731326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 262/529] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:17.731795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.737637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 268/530] 10.222.0.40 () {56 vars in 1139 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.738535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.786524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:17.859009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5a19-ebf3-482f-98ec-26ec5884925c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.870107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33a21-8213-4ec5-a9d5-d3afae83cdbb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:17.914614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.915343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.915625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.915800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:17.915924 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.916628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:17.916722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.917050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.917320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:17.917492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:17.918413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:17.918514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.918807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:17.920866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:17.936658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 263/531] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.936658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:17.954352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 269/532] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:17.955896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:18.028644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.086729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc0cde-c93b-4970-9989-9203507a3f85 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.098300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.130503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.131142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.131431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.131712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.132526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:18.132838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.134334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.147163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669edcd-c2ec-4905-b4cb-d1b42b72a018 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.156503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 264/533] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:18.157370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:18.195286 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.196608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.198042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.198471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.293810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4909-fc1f-47ef-a804-ff6931bec74f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.294981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.300483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.336567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.337457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.337912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.338339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.339337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1064e968daa5452983255aeec2883691) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:18.339818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.342084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.348851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 265/534] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:18 2022] GET /identity/v3/role_assignments?user.id=1064e968daa5452983255aeec2883691&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:18.350147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:18.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.411207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.419517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 270/535] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:18.429358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:18.545563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c4702-ac39-45e3-9917-1b3a04e735e1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.607045 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d23fd-9cf5-4715-8405-96661e4720e3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.610213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.611115 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.611603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.612763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.613795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1c0d2b6058dd4609aef49555bb568453) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:18.614851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.616584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.625786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 266/536] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:18 2022] GET /identity/v3/role_assignments?user.id=1c0d2b6058dd4609aef49555bb568453&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:18.651015 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.652071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.652640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.653135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.657303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.668196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.670623 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3539ccaf-2f98-4401-abd7-81e7abc63a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:18.690112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:18.691034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:18.691872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:18.691872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:18.691872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:18.691872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:18.694230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 271/537] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:18.699438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:18.789807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024394a-f363-4408-afd5-1f20062d354a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.790159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024394a-f363-4408-afd5-1f20062d354a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.790366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024394a-f363-4408-afd5-1f20062d354a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.791854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 272/538] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:18.798191 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.798771 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.799291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.830376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:18.833051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:18.865005 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:18.877652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318d393-5e05-4d97-8fdf-91af06387a63 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:18.956991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:18.957631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:18.957922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:18.958498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:18.959842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:18.960170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:18.961612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:18.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 273/539] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:18.987993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 267/540] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:18.993212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.034622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.192634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca707-fea8-4daa-812c-96323b80b9ec None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.227023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416182dc-b55a-4bd1-9644-f9e6d1133dc5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.236665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:19.271482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.272216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.272527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.273061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.273369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.274177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.274475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.274763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.288733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:19.293724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:19.295816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:19.296713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:19.297515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:19.298113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:19.302332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 268/541] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:19.303710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:19.328815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:19.330830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:19.333203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 274/542] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:19.336749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.337775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:19.503099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd001d0-226c-4fdb-bba4-9e1d2c88364c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.521149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacd36-f8aa-4345-b6a3-fa537c34c835 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.575662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.576890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.577938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.578591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.580032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:19.580948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:19.583069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:19.588138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.589037 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.589527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.590023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.590942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:19.591476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:19.593086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:19.609654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 269/543] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:19.610663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 275/544] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:19.615411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.616379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.691834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:19.771041 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:19.816307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a640-09b7-4067-ac5a-5cc57cdede75 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.834100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd6c6-1d9f-4480-82eb-971fa9c15b93 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:19.854787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.855695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.856131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.856592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.869260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:19.871072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:19.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:19.888446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:19.889293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:19.889293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:19.889293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:19.889293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:19.896522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 270/545] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:19.898473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:19.962044 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:19.962994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:19.963460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:19.963944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:19.968781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=9f13b2c9e912492a8e8fb7fec70236bb) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:19.969310 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:19.971022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:19.984851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 276/546] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/role_assignments?user.id=9f13b2c9e912492a8e8fb7fec70236bb&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:20.034227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628fb74-5a72-420f-b0d2-02cb73cf079e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.068665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:20.080725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.081874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.082370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.082910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.083863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:20.084405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:20.086144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b8461-e92c-4d3d-96ca-028185a501a6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:20.108435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 271/547] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:20.110353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.248427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e4fa-1869-454f-9b51-e29bc6cc5d7d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.248747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e4fa-1869-454f-9b51-e29bc6cc5d7d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.249000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e4fa-1869-454f-9b51-e29bc6cc5d7d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.251042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 272/548] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:20.258234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.258664 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.259400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.277416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd6cc-8999-4187-98c1-24d359c96627 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.280504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:20.282690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:20.287430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:20.368434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 273/549] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:20.383477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.384199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.384518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.384802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.386774 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.401156 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:20.402689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:20.426850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:20.428350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:20.429403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:20.436763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 277/550] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:20.445802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.505853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e747e-3428-4d61-bde3-2f6b37c8e8bc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.532661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:20.544835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.545426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.546059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.546351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.558387 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:20.564386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:20.565319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:20.566118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:20.570826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 274/551] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:20.572076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.688675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d88f-b5ac-406e-bd63-d8c6ac7866e6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.727574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.728372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.728667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.728948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.729683 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:20.729990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:20.731552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:20.746136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 275/552] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:20.746628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633084-6239-4951-861f-0062d34d8079 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.747992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.800732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:20.837210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.837841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.838158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.838808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.839895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:20.840206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:20.842466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbffca-bd7b-4491-9426-8df61386c268 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:20.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2cd17-e404-4fba-a587-95329b94ceb1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:20.865574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 278/553] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:20.866850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee276b-1466-4165-a739-782cbf5b0cdf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.867190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee276b-1466-4165-a739-782cbf5b0cdf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.867475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee276b-1466-4165-a739-782cbf5b0cdf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.872367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 279/554] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:20.874181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee276b-1466-4165-a739-782cbf5b0cdf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:20.903635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:20.913258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:20.914341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.914905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.915489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.929274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:20.931206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7d7e29d7-d365-4b27-bc5b-839fe97c8f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:20.947691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:20.948667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:20.949561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:20.949561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:20.949561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:20.949561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:20.956817 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 276/555] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:20.958474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:20.958972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:20.959456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:20.980794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:20.982853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:21.000241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee276b-1466-4165-a739-782cbf5b0cdf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.043352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.043889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.044170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.045032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.056384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 277/556] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:21.056565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.083224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.132751 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.134205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.156498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.172729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f32c7-6ab1-43ae-b6c2-bfd574ca1113 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.210007 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.210667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.210956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.211227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.211925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:21.212233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.213661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93c617-b52e-4ba5-b0b2-48481b6e1c9b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.226223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 278/557] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:21.227955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa3c8-56c1-459a-810a-ea7fcb631fcb None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.228247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa3c8-56c1-459a-810a-ea7fcb631fcb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.228673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa3c8-56c1-459a-810a-ea7fcb631fcb None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.232412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 279/558] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:21.233486 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa3c8-56c1-459a-810a-ea7fcb631fcb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.248062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 280/559] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:21.248062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.331966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.351583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bd69-885e-4905-9cf2-201840f8c365 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.353000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa3c8-56c1-459a-810a-ea7fcb631fcb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.372169 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.386952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.387717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.387971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.388204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.395457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.396935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.400705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.401557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.401991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.402417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e8139917-fcd6-404c-852b-f4cd33e1fd2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:21.409210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:21.410357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:21.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 281/560] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:21.412069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.412069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.412351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.419412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:21.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:21.425447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:21.426626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:21.430094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 280/561] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:21.430919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.435372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:21.436919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:21.512299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 282/562] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:21.512299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.550870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca725e9f-64ec-42fb-9eac-77cea708701b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.591245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.591825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.592112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.592422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.603681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.605179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.608975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.620876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f91f-0fee-40c1-8127-6f47aba2d7f9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:21.622902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:21.624047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 281/563] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:21.631426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.640628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.666513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.667150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.667439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.667719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.668592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:21.668910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.671325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.692130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 283/564] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:21.692926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.740887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec207bb-d8b1-4b57-b405-00ad0c637ae7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.776461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.777301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.777680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.778022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:21.779253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.780942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.789631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 282/565] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:21.789631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.800270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8132-dcd1-4896-b13b-2577321c56cd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.837367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.838108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.838460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.838869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.850473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:21.851169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:21.858440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:21.859583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 284/566] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:21.865386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.899658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:21.909298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b2f55-8f4c-4801-9c6a-355194e9b4a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:21.951552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:21.952319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:21.952632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:21.952954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:21.953692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:21.954029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:21.955431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:21.969248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 283/567] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:21.970180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:21.997916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a1db-b6e7-4596-95f2-654c80547bab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.034576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.035216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.035497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.035770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.046362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.047856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:22.064361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.065268 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:22.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:22.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:22.066154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 285/568] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.066839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.096627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc2ca-e580-4a5f-a608-81ef0c3318cc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.120027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.141647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.142395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.142685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.142962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.154275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.155729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:22.170789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.171698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.172652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:22.172652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:22.172652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.172652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:22.172652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 284/569] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.172954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.179573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.202780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe72c8-de0b-4a95-a20d-9cf13c810367 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.243039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.243695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.243985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.244278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.245011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:22.245322 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.246785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.254788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 286/570] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:22.255593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.284329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14270-b279-4e4e-b178-8ed17bf3b7f8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.318384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.319031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.319317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.319594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.326305 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.327961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:22.340617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.342225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:22.343233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 285/571] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.343725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.357801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3e50a-2952-4a3c-9db0-4eec941e6e4c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.375232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.395112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.395784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.396099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.396450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.397205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:22.397554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.399000 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feaef7-b078-4857-80f2-135e64f1a48b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.413715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 287/572] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:22.414949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cda-0cd1-4916-b943-d2c958016980 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.415242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cda-0cd1-4916-b943-d2c958016980 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.415616 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cda-0cd1-4916-b943-d2c958016980 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.420873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 288/573] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:22.421510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42cda-0cd1-4916-b943-d2c958016980 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.425119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.450258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cc9f-2027-4897-86ab-f265d6b85d7a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.486139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.486757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.487049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.487331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.488023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:22.488372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.489772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.501729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 286/574] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:22.502539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.528038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42cda-0cd1-4916-b943-d2c958016980 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.564152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.564831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.565115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.565396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.577042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.578738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.591779 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:22.594122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.594985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.595894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:22.595894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:22.595894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:22.595894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:22.595894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 289/575] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.596167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.606290 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca2a4-845b-4671-bfc1-eede881290b9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.641535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.642094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.642379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.642655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.643408 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:22.643713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.645167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3da92-dc80-4a7e-af0e-affb4bb4705f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.652471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.662376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 287/576] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:22.662376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.662376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.662376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.677436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:22.678698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:22.706287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2a39a-b1ed-4432-b451-5e3c3af27c71 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.740489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.741146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.741437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.741788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.749183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.750655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.751930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 288/577] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:22.752884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:22.762178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:22.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 290/578] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.765938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.844542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.864240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee40b7c-4137-4e34-bddf-d59801c0a0d6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.867864 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e87ec-beb9-426f-b81d-bac7dae120a1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:22.883525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:22.899300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.899867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.900148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.900451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.906075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:22.906741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:22.907060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:22.907361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:22.907787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.908117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:22.908497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:22.909259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.909997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:22.920701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:22.921961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 289/579] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:22.923073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:22.924603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 291/580] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:22.925488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.026147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8e1e-585e-411d-bfc5-5e66022f68c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.028283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafc36b-1b17-4c46-b38c-e18d35aa11a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.059178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.060346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.060640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.060917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.061071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.061669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:23.061773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.061959 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.062056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.062234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.063017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=4fa95647578f48108da5f532c53ae3c1) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:23.063326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.063413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.070342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 290/581] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/role_assignments?user.id=4fa95647578f48108da5f532c53ae3c1&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:23.070944 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.074449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.082557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 292/582] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:23.082557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.135075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.187343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7545d8-3026-48ec-97bc-8dc03c5eb5eb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.215319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302366-88c3-4a19-84ad-5869f87196e2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.222519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.223411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.223671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.234885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:23.240412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:23.241401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:23.242406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:23.246382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 291/583] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:23.247094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.262546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.263684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.263966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.264505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.272007 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.273481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:23.284939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:23.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 293/584] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:23.286961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.321573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.363088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051233-2a01-414a-9a96-6ee803337adc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.390905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.398691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.399317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.399420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a30c6-9210-4751-bda4-92ddd39c43aa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.399596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.399870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.400697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:23.401153 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.403394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.440053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.440706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.440999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.444812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 292/585] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:23.445835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.462368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=d7b7ff8e53f84c30a43f0f8218ef6d30, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.463825 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.477455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 294/586] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:23 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:23.478055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.599424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3754dab-eff6-43c8-be2e-6d5c6e972429 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.602759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319dcf-2f05-4f4b-9a65-6225da2ea4f1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.634293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.639389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.639961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.640265 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.640551 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.641487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:23.641670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.643874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.652410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.653462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.654548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.655115 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.655992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:23.656435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.658065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.666331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 295/587] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:23.667185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.668417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 293/588] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:23.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.675199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.796373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0b2e-6cdc-4815-9f74-ade1e12141af None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.799480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b093-80a2-40b0-bf42-07e9a995fe8d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:23.837552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.839158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.839158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.839158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.845878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:23.846814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:23.847293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:23.848387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:23.852000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.853902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.862126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:23.864868 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:23.871699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:23.873033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:23.873906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:23.873906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:23.873906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:23.873906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:23.876331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 294/589] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:23.877373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:23.887513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:23.889424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:23.890296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:23.890296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:23.890296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:23.890296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:23.892912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 296/590] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:23.894593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:23.930917 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:23.967938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.022551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9b45-b963-43a5-8d0e-1913b4cb80ce None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.030469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800843b5-5eb1-45f9-9754-8476ef33c6e5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.070250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.071264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.071652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.072121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.076829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.077627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.078050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.078481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.079357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:24.079805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.081892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.084935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.086972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.097474 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 297/591] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:24.098503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:24.115186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:24.116339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:24.117410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:24.117410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:24.117410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:24.117410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:24.123498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 295/592] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:24.123498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.227912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511bd3-945f-4cb7-8820-78fec2744a94 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.239603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.246089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.264036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df72-8b19-4403-ac5e-824087f783b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.270419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.271184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.271581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.271958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.272822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:24.273238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.274829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.288112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 298/593] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:24.293324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.311994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.313204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.313634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.314068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.323671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.326901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:24.342491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:24.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:24.344667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:24.346845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 296/594] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:24.347749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.422746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ad64c-06d0-431f-b9b7-ca18ed453741 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.457553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c42a-8920-455c-9ab6-215c273d266f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.471427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.472518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.473008 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.473884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.474985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:24.475539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.478035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.498289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 299/595] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:24.498289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.504283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.505209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.505726 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.506737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.517151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.519225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:24.534571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:24.535499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:24.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:24.540681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 297/596] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:24.541554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.542897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.553694 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.636435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e127-d4f8-45ed-9892-b9f2d2ded44f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.655226 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c65d-d4ce-4af0-97b3-322f5f2ea534 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.688350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.689520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.689976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.690422 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.691347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:24.691858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.693083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.693713 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.693820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.694180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.694534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.703665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.705299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.712425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 300/597] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:24.713576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:24.724891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:24.725845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:24.726847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:24.731046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 298/598] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:24.731968 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.811685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.843449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:24.850920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f20e3-fb61-48d2-924c-c0b0571c3690 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.854274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf892e-ecda-477d-b393-202b0f8ba06c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:24.890265 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.890996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.891356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.891714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/1c0d2b6058dd4609aef49555bb568453/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.900104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:24.901329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:24.901787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:24.902263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:24.903191 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:24.903702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.906866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.912878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=1c0d2b6058dd4609aef49555bb568453, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:24.915130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:24.926240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 301/599] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:24.927523 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:24.936522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 299/600] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:24 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/1c0d2b6058dd4609aef49555bb568453/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:24.937347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.128610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf609c-92e0-4f3f-a564-6343e08f0a8e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.165966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3495-8845-403e-bd44-d7321f930769 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.181299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.182440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.183141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.183429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.184238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:25.184575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.186276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3222e-b3c6-41cf-a08d-ab5dc243e9b3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.186743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:25.207281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 302/601] 10.222.0.40 () {56 vars in 1139 bytes} [Sun Jul 31 01:00:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:25.208576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5f7b-83d5-4e33-8b1c-454572bda263 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.208862 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5f7b-83d5-4e33-8b1c-454572bda263 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.209132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5f7b-83d5-4e33-8b1c-454572bda263 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.210328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 303/602] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:25.213280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5f7b-83d5-4e33-8b1c-454572bda263 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.220117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.220837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.221114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.221386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/1064e968daa5452983255aeec2883691/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.234631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:25.244744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=1064e968daa5452983255aeec2883691, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.247860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0468c09-ea94-43cc-9bd2-1d73944cf981 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.268652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 300/603] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:24 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/1064e968daa5452983255aeec2883691/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:25.270825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.271738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.272215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.297370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:25.300017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:25.357327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5f7b-83d5-4e33-8b1c-454572bda263 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.390149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 301/604] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:25.416093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.443600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.444269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.444561 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.444881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.467728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.469606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:25.488997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:25.489983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:25.490880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:25.490880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:25.490880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:25.490880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:25.493439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 304/605] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:25.500069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.573382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:25.603602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:25.609663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c60b4-abeb-4d87-b231-ecebe02c34ed None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.614911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d9864-e1ba-46ee-92f7-3b14241ab298 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.652727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.653379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.653690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.653903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.654029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.654731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.655024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.655306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.656345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:25.657092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.658482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.671831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:25.673540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 305/606] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:25.676757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:25.677688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:25.678510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 302/607] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:25.686536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.687100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.812786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba815d-49cd-4db1-b209-c12c911dc8e3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.837635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:25.849678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.850654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.851141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.851622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.859538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.861300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.869227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac0e7-edf3-4e87-93a8-cf6711dbee49 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bb9a4967-b369-4fc5-8a78-cdb3d5aa44b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:25.873742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:25.874600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:25.875459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:25.877941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 306/608] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:25.879410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011305e7-2d0e-4cb0-a198-e0f20400050d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.879916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011305e7-2d0e-4cb0-a198-e0f20400050d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.880441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011305e7-2d0e-4cb0-a198-e0f20400050d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.882141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 307/609] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:25.883483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011305e7-2d0e-4cb0-a198-e0f20400050d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:25.915637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:25.917052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.917539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.918416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.920222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:25.920778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:25.923252 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13f7a0-0401-419c-91dc-f43cfbaea600 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:25.934185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 303/610] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:25.935952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:25.936441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:25.936882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:25.961428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:25.962995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:25.980867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.031300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011305e7-2d0e-4cb0-a198-e0f20400050d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.045419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 304/611] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:26.046423 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.072917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.073809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.074679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.075107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.076231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:26.076837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.078726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.095720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 308/612] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:26.096941 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.155715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.190487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18722b0-e65b-4d4b-897f-dd03297cbb83 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.226325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d82906-c6f7-4652-9af8-8165d32ffaea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.228558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.229276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.229562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.229893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.241692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.243185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:26.263996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:26.264955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:26.265833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:26.265833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:26.265833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:26.265833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:26.267524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 305/613] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:26.271580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.272019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.278020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.279240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.279588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.279804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.292089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:26.297162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:26.298073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:26.298917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:26.303438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 309/614] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:26.304382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.406526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882730ed-1591-44db-9429-9fbc38f2535d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.419717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c66dd-2e87-4b88-9a42-e18426748f56 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.422248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.457470 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.458762 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.459680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.460441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/9f13b2c9e912492a8e8fb7fec70236bb/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.464136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.464819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.465103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.466263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.466263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:26.466542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.467870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.480858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=9f13b2c9e912492a8e8fb7fec70236bb, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.483141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.485263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 310/615] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:26.486370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.499625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 306/616] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:26 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/9f13b2c9e912492a8e8fb7fec70236bb/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:26.500781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.568751 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.633790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db432487-a09b-454f-8b72-1d28d718cd57 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.676763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.678342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.678844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.679320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.691249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.693357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.707398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a240f-29ee-4080-b0a9-36ae8ec62df5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:26.709663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:26.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:26.711484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:26.714724 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 307/617] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:26.721102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.797116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.797780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.798068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.798355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.799093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:26.799405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.800925 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.819881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 311/618] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:26.825134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:26.851935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dffad-fa19-4825-84d0-8130a263cf2b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:26.867734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.883106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:26.897909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:26.898552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:26.898847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:26.899121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:26.899910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:26.901241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:26.901904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:26.929536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 308/619] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:26.937183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.048480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f661-7f6b-492c-bcc2-1ba4fe5c5194 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.080056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb299a-f0e8-4f1f-80f1-e3888095d4f3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.087536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.088246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.088561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.088843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.101458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.103040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:27.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:27.126019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:27.126945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:27.126945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:27.126945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:27.126945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:27.126945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 309/620] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:27.127746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.155951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.158106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.158845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.159137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.159449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.180860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.182611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:27.207091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:27.208017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:27.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:27.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:27.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:27.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:27.209355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 312/621] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:27.218407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.247087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523d76-0302-4c08-94fc-5e4dddaccd85 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.286264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.287190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.287469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.288247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:27.288712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.290147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4f3aa-1143-4586-bc30-4a41115165b7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.306499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 310/622] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:27.309015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49104-5c40-448c-89f5-50f9b5ba26a8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.309299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49104-5c40-448c-89f5-50f9b5ba26a8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.309573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49104-5c40-448c-89f5-50f9b5ba26a8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.316328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 311/623] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:27.317428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49104-5c40-448c-89f5-50f9b5ba26a8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.342961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.366842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f176416-9c68-4c5b-9a90-8ee08e1b15b8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.402626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.403253 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.404151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.404468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.405211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:27.405517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.406958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abe9f-c990-47e6-ac35-2f099069a386 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.421352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 313/624] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:27.422601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.422882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.423153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.439336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.442537 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:27.443945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:27.469135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49104-5c40-448c-89f5-50f9b5ba26a8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.511551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.512201 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.512525 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.512827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.520055 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.521550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.524858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 314/625] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:27.525832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:27.542411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:27.544624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:27.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:27.552710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 312/626] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:27.558612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.624170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.660678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878884e-6cea-48ae-ad78-59c742ed516c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.667225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f3b1f-4583-4c49-83f7-60f770a6b355 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.696433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.697081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.697357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.697631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.703165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.703860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.704104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.704416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.705487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.706934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.715327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:27.719181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:27.720088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 315/627] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:27.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1073be61-b167-4f02-a3a6-2a78f750ed61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:27.726819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:27.727827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:27.729018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 313/628] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:27.729717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960630-0017-4f47-9a48-0e5810cd8e60 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.730103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960630-0017-4f47-9a48-0e5810cd8e60 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.730282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960630-0017-4f47-9a48-0e5810cd8e60 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.731703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 314/629] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:27.735999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960630-0017-4f47-9a48-0e5810cd8e60 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.735999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.843105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960630-0017-4f47-9a48-0e5810cd8e60 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.847919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde73a7-44b3-4ef6-8bf5-e6e7af621371 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:27.879042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.879957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.880241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.880856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:27.881063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:27.881375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.882964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.893525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:27.894162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.894595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.894876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.895643 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:27.895952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:27.897439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5b8c-183b-47c3-9dc0-baa235d00953 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:27.909299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 315/630] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:27.909299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:27.920637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 316/631] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:27.920637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:27.920637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:27.920637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:27.938408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:27.939606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:27.972865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.010250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 317/632] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:28.011111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.026637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546caa1d-1dff-4672-8236-da766b033571 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.066968 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.067600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.067884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.068350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.069190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:28.069522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.070883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.081459 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 316/633] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:28.082135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.140793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97483a30-012f-4f42-bf4f-112f9f510c4a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.160929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.183306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.183929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.184213 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.184521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.202426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544acd9-b65b-46d9-a3bc-ef5e23f64d28 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.228044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.242295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.243050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.243409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.243782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/4fa95647578f48108da5f532c53ae3c1/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.258024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.259508 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.259710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=4fa95647578f48108da5f532c53ae3c1, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.261278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.274344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 317/634] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:28 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/4fa95647578f48108da5f532c53ae3c1/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:28.275255 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.395392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0f87-ad5a-45a0-ad01-f40e10ef9ecb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.420967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 318/635] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:28.422324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.440471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.441324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.441711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.442090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.449100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.456226 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:28.461503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:28.462690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:28.463739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:28.465019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 318/636] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:28.465847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.505216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.593934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d925-50d1-4131-a7e4-0260c5eb30da None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016773-4053-40d8-901d-482e37a57aff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.637661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.639597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.640161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.640690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.641367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.642222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.642685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.643157 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.655667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.657496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.658004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.659973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:28.673971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:28.674921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:28.675792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:28.675792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:28.675792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:28.675792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:28.677429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:28.678295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:28.679264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:28.679264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:28.679264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:28.679264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:28.680486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 319/638] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:28.681525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.683714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 319/638] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:28.686675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.762163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.783430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:28.799377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1693d27-cda3-477e-8a6e-1d06409cdc7b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.801105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133795-8037-4da1-b55e-cc9c1a0f262e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:28.839035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.839250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:28.839946 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.840230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.840556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.840835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:28.841317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:28.841629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:28.841808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.842313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:28.843263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:28.843768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:28.843949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.846858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:28.856557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 320/639] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:28.857851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.863217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 320/640] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:28.864072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:28.979895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a785d-e2d1-41b4-8ea0-65fb1cccb590 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.001990 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ae56f-426f-4181-a457-b0ecf1ebc496 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.030239 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.030899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.031184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.031457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.038610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.042103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.043545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.044727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.045473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.045921 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.046364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.048139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:29.048401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.049763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859daea-2003-4237-a300-fc2e651606a8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:29.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:29.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:29.062377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:29.062377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:29.062377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:29.062377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:29.064574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 321/641] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 321/642] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144197-d9cb-41bd-b6b7-9fe299faf637 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144197-d9cb-41bd-b6b7-9fe299faf637 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144197-d9cb-41bd-b6b7-9fe299faf637 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 322/643] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:29.069243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144197-d9cb-41bd-b6b7-9fe299faf637 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.070521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.180562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472486e3-9091-4629-b561-20725dae48c5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.192598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144197-d9cb-41bd-b6b7-9fe299faf637 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.218164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.218908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.219204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.219490 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.226647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.228102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.235748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.236472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.236848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.237179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.238047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:29.238500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.239997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fece91-8e71-40e2-8b54-713e20249bf5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:29.244059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:29.245047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 322/644] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:29.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.261997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 323/645] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:29.261997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215463-3b21-48a8-a668-e756117e055e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.261997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215463-3b21-48a8-a668-e756117e055e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.261997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215463-3b21-48a8-a668-e756117e055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.277639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-99215463-3b21-48a8-a668-e756117e055e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:29.278930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-99215463-3b21-48a8-a668-e756117e055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:29.319987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.334391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.359105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 324/646] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:29.359955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215463-3b21-48a8-a668-e756117e055e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.377893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8bd8-5746-4b22-8204-4b1932d23eb2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.414211 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.414860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.415149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.415427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.424315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.425735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:29.438167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:29.439139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 323/647] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:29.440151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.468131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215463-3b21-48a8-a668-e756117e055e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.507383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.507945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.508236 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.508544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.509312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:29.509621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.511065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.523891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 325/648] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:29.524808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.560205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c903-3f67-466e-9831-a79a83b63f0e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.577364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.581596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.598353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.599008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.599292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.599572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.608409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.609849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:29.621888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:29.622913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 324/649] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:29.628720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.653854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a853-e123-4009-a290-bbc419b41f97 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.697751 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.698037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.698495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.709432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:29.714812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:29.715739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:29.717173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 326/650] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:29.718736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.751714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721bd29-0f33-43f2-bec6-9e28b3e6964c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.787138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.787694 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.787974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.788308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.789047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:29.789626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.790794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.808993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 325/651] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:29.814046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.824580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa5782-e6b5-41c8-9ee7-a5b9365a8143 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:29.827386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.851999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:29.862705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:29.863658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:29.864094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:29.864408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:29.865213 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:29.865526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:29.866965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:29.873625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 327/652] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:29.874493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:29.961973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a632af-33f2-4ef6-8105-b37e407b6f4b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.014113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.014759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.014976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.015224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.016061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:30.016431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.017978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.023335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53716-eb9f-4a95-935e-c6972f621c33 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.044408 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 326/653] 10.222.0.40 () {56 vars in 1137 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:30.045672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.074811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.076461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.076926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.077377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.078396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:30.078697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.080196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.089404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 328/654] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:30.090080 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.125630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.166608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.178775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1182f68-4915-49a2-94f5-4063241d0d93 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.221313 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.221940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.222222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.222497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.232185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3f49-c001-4515-b899-d0061a31b64c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.281831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.283468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.283948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.284830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.295491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.296972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.394277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.396088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.401502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.414876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 327/655] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:30.416068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.432062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.512298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 329/656] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:30.512513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.549052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb7a5-1b77-4c99-acde-c8e7509f3297 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.590882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.592155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.592535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.592836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.609364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.611371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.617421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303430c-42bd-4b82-a55a-77a2cb8e7819 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b8cb3188-ea9d-4886-a9e3-1aa4e475b94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:30.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:30.630604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 328/657] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e887-ecd3-4aa9-b1ee-1b41b305bc05 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e887-ecd3-4aa9-b1ee-1b41b305bc05 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e887-ecd3-4aa9-b1ee-1b41b305bc05 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.638227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 329/658] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:30.638886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e887-ecd3-4aa9-b1ee-1b41b305bc05 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.653758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.654415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.654703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.654983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.665406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.666878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:30.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:30.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 330/659] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:30.689682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.697000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.761594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e887-ecd3-4aa9-b1ee-1b41b305bc05 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.797820 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178961-c571-4020-99eb-8245b657aa3d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:30.798273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.798926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.799278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.799499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.810145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.811579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-70418298-ad92-49cf-9be8-4e004d3f6fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:30.826653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:30.827729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:30.828833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:30.828833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:30.828833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:30.828833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:30.832611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 330/660] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:30.833880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.834231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.834453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.835482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:30.836176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:30.836557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:30.836904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:30.837673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:30.838051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:30.839491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:30.852231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:30.857638 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 331/661] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:30.857638 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.857849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:30.902385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.932457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 331/662] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:30.932457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:30.961640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:30.979215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf0de3-60a9-4f15-8c2c-dfdcbea761f5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.017971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.018717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.019075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.019429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.020221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.020631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.022119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.040293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 332/663] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.040293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.159179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.163902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16defd-63fd-4eab-bd9c-269d8c2f7865 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.166737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea23ce-8bc1-412e-8cf3-cc586de24893 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.200176 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.200837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.201118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.201392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.202119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.202425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.203786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.205152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.205508 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.205851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.213797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.215338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.220875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 332/664] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.220875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:31.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:31.234315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:00:31.235429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:31.235976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 333/665] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:31.236559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.318602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.337456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c7337-43e3-4741-8f11-c2133f5f7eff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.345528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db16d4-2849-4c68-8181-1c0181f14155 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.372526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.373288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.373597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.373950 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.378653 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.379370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.379760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.380067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.384554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:31.386874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.388877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:31.390058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:31.391158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:31.392059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 333/666] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:31.392789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:31.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:31.407540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:31.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 334/667] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:31.413257 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.435398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.500637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934fc3-bf47-4cff-8e66-7a2d48464176 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.516604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdcece-ea2f-42e4-aba1-6b580a740e94 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.535380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.536048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.536356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.536636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.545381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.551104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.551731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.552016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.552311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.553108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.553415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.554828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:31.557440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:31.558319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:31.559204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 334/668] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:31.560953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.569575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.584323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 335/669] 10.222.0.40 () {56 vars in 1139 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.584323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.665284 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.673854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d16d-9ae7-4693-bb83-0721abdba4cf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.687683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fc5b-bbef-41a0-a93e-2351a2d8840a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.710269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.711168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.711648 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.712086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.712897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.713213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.714583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.723140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.723319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 335/670] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.728118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.728118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.728409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.728409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.728409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.728409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.739418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 336/671] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.741181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.806050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.845006 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cc238-1f64-41fc-a37a-0376f84df3ac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.851484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66ca8-c9e0-4d2f-b878-0a651056b89e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:31.882225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.882839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.883122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.883395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.884144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:31.884483 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.885467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:31.885913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:31.886101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:31.886355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:31.886628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:31.898788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 336/672] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:31.899442 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:31.900135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:31.968747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:31.970376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.006191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74a297-f20d-41ad-a487-c969667afdd2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.034015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.043259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.043930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.044761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.045035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.056089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.057858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:32.073188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:32.074264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:32.075404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:32.075404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:32.075404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:32.075404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:32.075633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 337/673] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:32.076005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.078912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 337/674] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:32.079768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.116524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.177402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677068d-bdb8-4907-a2ba-4897188f66b9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.183106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64461-9059-4f37-9b06-d26aa927dd81 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.211098 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.211708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.211999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.212300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.213093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1c0d2b6058dd4609aef49555bb568453) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:32.213411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.214852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e4755-d398-4d5b-9908-665415262fc1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.216672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.217420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.217701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.217990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.218838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1064e968daa5452983255aeec2883691) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:32.219094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.220535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.221078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 338/675] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/role_assignments?user.id=1c0d2b6058dd4609aef49555bb568453&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:32.222333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fb02-7a7e-4f67-b4a3-c2be79961251 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.222627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fb02-7a7e-4f67-b4a3-c2be79961251 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.222908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fb02-7a7e-4f67-b4a3-c2be79961251 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.224111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 339/676] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:32.224845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fb02-7a7e-4f67-b4a3-c2be79961251 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.237732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 338/677] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/role_assignments?user.id=1064e968daa5452983255aeec2883691&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:32.239152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.301169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.387070 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482ea18-0bbd-4eaf-b030-26143da63895 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.401950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fb02-7a7e-4f67-b4a3-c2be79961251 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.404386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.434516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.435983 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.436281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.436568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.449432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.449830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.450495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.450784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.451067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.451777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:32.452083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.453219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.453525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfda8a2-993f-4141-953f-2017ebf6e719 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.468923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 340/678] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:32.469730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.470027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.470312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:32.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:32.471417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:32.472508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:32.472508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:32.472508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:32.472508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:32.474412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 339/679] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:32.475368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.496927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:32.498706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:32.571099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 341/680] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:32.572283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.587920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.596194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15c60-2b71-4bfc-861a-ff1f3779da9d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.635654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.636447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.636737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.637017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.646456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.648078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:32.661659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:32.662661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:32.663611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 340/681] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:32.664828 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.674295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.688084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf065d5-136f-4471-82fa-15f36b629c77 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.723967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.724566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.724852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.725130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.725833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:32.726141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.727526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.739715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 342/682] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:32.740646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.785487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ed10d-a07a-45cd-89d0-429400f629b9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.833663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.834367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.834652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.835471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.847265 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f266268-6f44-4f29-9026-cebfbb9262b6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:32.849365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:32.856278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:32.858981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:32.861085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 341/683] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:32.863136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.882223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.889447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:32.890074 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:32.890381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:32.890626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:32.891435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:32.891866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:32.893359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:32.916276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 343/684] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:32.917187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:32.931798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:32.990994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2a64-3d92-4a70-9abc-f91890724eb1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.030194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be1c-a078-49fc-9d01-e20faf623a71 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.034626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.035456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.035883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.036363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.045206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.046650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:33.063111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:33.064051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:33.064958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 342/685] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:33.065931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.084359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.084996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.085280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.085612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.086345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:33.086708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.088299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.098581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 344/686] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:33.099307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.156812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.181307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5e71-4565-43dd-8450-d7d4c9124911 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.187065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.216535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.217314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.217695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.218069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.222643 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617792-22e3-43fa-8843-8f37deccdd41 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.259364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.260469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.260966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.261420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.262462 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:33.262994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.264837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.283783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 345/687] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:33.284983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.290465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.291934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.373836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.393137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6bff1-5b9d-4788-9a2f-b58879da2832 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.399276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 343/688] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:33.400132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.425408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.431428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.432690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.433201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.433678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.444568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.446391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:33.462101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:33.463054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:33.463966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:33.463966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:33.463966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:33.463966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:33.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 346/689] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:33.467758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.510119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e37e-7134-4e16-8ccc-94735723ce54 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.548395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.549023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.549304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.549580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.550365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=9f13b2c9e912492a8e8fb7fec70236bb) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:33.550672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.552204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.564735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 344/690] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/role_assignments?user.id=9f13b2c9e912492a8e8fb7fec70236bb&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:33.564735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.597206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d7a2b-edc7-4cf1-a4a0-475828452be6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.608672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.666743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.667816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.668379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.669388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.672587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0e53-9e05-4b5b-a818-f1f0c07da059 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.692949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.695584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.711710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.713138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.713250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.713672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.714983 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:33.715780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.717854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:33.728086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:33.729055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:33.730013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:33.730013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:33.730013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:33.730013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:33.732863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 347/691] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:33.738224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 345/692] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:33.739517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.743196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.808521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.864293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a057c-e578-408c-bcd3-841d931475b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.888536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:33.909426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.910620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.911251 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.911754 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.922287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.924097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.930947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c624c-fe0a-407a-98ef-46a3b118f181 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:33.938931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:33.939920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:33.940897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:33.943510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 346/693] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:33.954611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:33.981188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:33.982355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:33.982629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:33.982898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:33.983601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:33.983913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:33.985376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:33.999981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 348/694] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:34.005959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.070307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536e10b-ca0e-4099-bd17-b4238a3b1b60 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.113204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.113857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.114154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.114474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.115375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:34.115789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.117338 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.120437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.125656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d97c4-0004-4def-83dc-9bd9898054df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.148969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 347/695] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:34.149709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.178613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.179963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.180464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.180887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.184240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.189393 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.191029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:34.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:34.205025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:34.206144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:34.208353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 349/696] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:34.214083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.270204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee4c7b-0e08-4d3d-b093-be27f406dc00 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.311122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.312586 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.312977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.313372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.393286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.407226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e31f6-83ce-4e60-9a4b-fe2bd598d316 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.412159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.446189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.447406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.447914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.448369 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.449299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:34.449752 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.452063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.466442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 350/697] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:34.472808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.500687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.503518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 348/698] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:34.508923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.582912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a5155-d4e7-45f3-aeb2-34a16f41364a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.621379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.622440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.623141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.623419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.624579 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=4fa95647578f48108da5f532c53ae3c1) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:34.625154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.627315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28d2d6-d9db-4bd8-a6b2-8d617c2dda43 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.628769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9a6b-c777-4f6e-b7f5-926533fffcb8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.634275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 351/699] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/role_assignments?user.id=4fa95647578f48108da5f532c53ae3c1&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:34.635513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0f4f-5be7-463a-935f-4af53c4d1bd4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.635794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0f4f-5be7-463a-935f-4af53c4d1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.636066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0f4f-5be7-463a-935f-4af53c4d1bd4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.643500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 352/700] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:34.652197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc221e-5743-4356-8c3d-0379895bde95 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.652556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc221e-5743-4356-8c3d-0379895bde95 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.652778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc221e-5743-4356-8c3d-0379895bde95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.677065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-08cc221e-5743-4356-8c3d-0379895bde95 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:34.678313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-08cc221e-5743-4356-8c3d-0379895bde95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:34.685259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.685940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.686235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.686518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.691191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.705237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.707836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e1652005-71a6-4209-8d82-cb7f739e7e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:34.729837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:34.730987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:34.732516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:34.732516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:34.732516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:34.732516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:34.732516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 349/701] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:34.733765 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026a7d-5cbb-4a43-bd2f-0c3a37c30a43 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.734065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026a7d-5cbb-4a43-bd2f-0c3a37c30a43 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.734353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77026a7d-5cbb-4a43-bd2f-0c3a37c30a43 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.741291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 350/702] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:34.742341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77026a7d-5cbb-4a43-bd2f-0c3a37c30a43 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.762313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 353/703] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:34.769634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.769979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.770267 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.807667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:34.808918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:34.813492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:34.881169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77026a7d-5cbb-4a43-bd2f-0c3a37c30a43 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:34.888456 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 354/704] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:34.890269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.936277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:34.936906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:34.937187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:34.937461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:34.938166 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:34.938470 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:34.939844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:34.955882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 351/705] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:34.956652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:34.993867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.055401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f114-ebce-443b-a350-9fe0a53112cd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.075947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd7e30-315d-4c97-b92d-77dbef0147bf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.092009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.092703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.092985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.093261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.102335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.105573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.108294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.118283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.119182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.119622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.120037 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.120956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.123025 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:35.130677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:35.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:35.132851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:35.132851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:35.132851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:35.132851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:35.135929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 355/706] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:35.135929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:35.141830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:35.142693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 352/707] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Jul 31 01:00:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:35.144053 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.262421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232fba-3d06-4676-a122-9b636f2c9643 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.276805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2766c3b-ca34-4e89-8cb8-96e94672dd18 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.279339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.311026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.311647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.311934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.312212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.319265 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.319722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.320453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.320952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.321222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.321623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.322566 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:35.323154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.324993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:35.334430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:35.335395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:35.336325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:35.337250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 356/708] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:35.338062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.347610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 353/709] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:35.348931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.401258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.453917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b84cd-392c-4923-ba29-375a6e64ef42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.459830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4d35-b5b1-4d0d-92f6-e92975771bb6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.490604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.491264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.491824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.492644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:35.492954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.494460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.499450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.500437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.500924 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.501397 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.502404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:35.502921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.504576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.505180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 357/710] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:35.506054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.523234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 354/711] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:35.524501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.541150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.618960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115261-c7aa-494b-ac75-017e26e644a9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8198cd-1e1b-4c5c-8713-f0a3b0edaf7f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.638307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.658939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.660557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.661032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.661459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.662915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.665059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdb833-971f-46ee-8e9d-bdda6e23a4be None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.670681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.671410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.671792 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.672168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.672981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:35.673381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.674926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.685733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 355/712] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:35.685733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:35.700342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 358/713] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:00:35 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:35.813540 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:35.843098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b951ea-4696-4fce-895f-797e644c7010 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:35.897191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:35.897831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:35.898113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:35.898386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:35.899191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:35.899503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:35.900997 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10c8b3-c9da-471f-9b44-445a0c439420 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:35.907992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 356/714] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:35 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:36.233818 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76eac-5b6a-4e04-bbb5-274fac61150b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:36.234153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76eac-5b6a-4e04-bbb5-274fac61150b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:36.234390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76eac-5b6a-4e04-bbb5-274fac61150b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:36.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 359/715] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:36.241684 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:36.241978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:36.242262 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:36.260953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:36.262169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:36.355098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 357/716] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:36.394739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76eac-5b6a-4e04-bbb5-274fac61150b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:36.527162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76eac-5b6a-4e04-bbb5-274fac61150b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:36.568710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:36.569484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:36.569794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:36.570104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] PATH_INFO: `/v3/services/network` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:36.570785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:36.572371 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:36.586437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:36.587473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:36.588323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:36.591699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 360/717] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:36 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:36.595012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:36.732877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:36.776604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16a6e0-116b-450a-926b-15c8334f31be None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:36.825659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:36.826296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:36.826578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:36.826850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:36.827533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] RBAC: Adding query filter params (name=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:36.827836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:36.829394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14098e5d-8f9e-46c6-9b5a-9ab512d63936 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:36.840346 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 358/718] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:36.845855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:36.898415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:36.995121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cab2-fb25-4437-a905-11cad8361f5a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:37.038035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:37.038674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.038963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.039241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.039929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] RBAC: Adding query filter params (type=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:37.040237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:37.041648 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d31b6-1a5c-4f2f-a824-ef8694ba4b8e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:37.047507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 361/719] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:37.158631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1161-2fab-49ad-b2c3-62bb8103e905 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.158957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1161-2fab-49ad-b2c3-62bb8103e905 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.159201 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1161-2fab-49ad-b2c3-62bb8103e905 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.160886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 359/720] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:37.166423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.166788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.166990 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.187614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:37.188949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:37.284128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 362/721] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:37.317245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1161-2fab-49ad-b2c3-62bb8103e905 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:37.440962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1161-2fab-49ad-b2c3-62bb8103e905 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:37.485358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:37.486014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.486301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.486579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.496580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:37.504588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:37.510106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:37.511030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:37.511853 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:37.514995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 360/722] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:37.520800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:37.566037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:37.672069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8014fa-1fc9-4c3d-b474-989b33bbffce None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:37.717589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:37.718229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.718515 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.718797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.719527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:37.719835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:37.721271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:37.730262 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 363/723] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:37.735490 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:37.894105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcb798-b5f6-4985-86b4-13b09b1bab12 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:37.939784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:37.940473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:37.940764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:37.941048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:37.952587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:37.954053 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:37.980651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:37.981645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:37.982624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:37.982624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:37.982624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:37.982624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:37.982624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 361/724] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:37.989164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.123851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.136496 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a624-f606-48cf-9787-9c7f9d343d42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:38.173191 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:38.173797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.174083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.174410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.175117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:38.175423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:38.176833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e13f-0924-4cbe-b1f7-a0e52c8cebe9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:38.190067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 364/725] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:38.195383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.277858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.377201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae38-c93f-4fba-b568-6e265586a2e2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.377527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae38-c93f-4fba-b568-6e265586a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.377762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae38-c93f-4fba-b568-6e265586a2e2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.379351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 365/726] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:38.382027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd7a1-0870-435f-a8b4-2f9fd41e8591 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:38.384472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084fc7-2808-4af7-ac9f-d866aabe3055 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.384762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084fc7-2808-4af7-ac9f-d866aabe3055 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.385037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084fc7-2808-4af7-ac9f-d866aabe3055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.431711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-04084fc7-2808-4af7-ac9f-d866aabe3055 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:38.433212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-04084fc7-2808-4af7-ac9f-d866aabe3055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:38.436903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:38.437560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.437846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.438121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.446692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:38.448141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:38.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:38.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:38.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:38.482623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 362/727] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:38.489317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.579808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 366/728] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:00:38.581341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dbadb-0196-473e-90de-59435b50f60e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.581635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dbadb-0196-473e-90de-59435b50f60e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.581972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dbadb-0196-473e-90de-59435b50f60e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.587317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 367/729] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:38.588806 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2e51-3e4b-43eb-b58a-b47cb37c67ec None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.589100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2e51-3e4b-43eb-b58a-b47cb37c67ec None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.589381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2e51-3e4b-43eb-b58a-b47cb37c67ec None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.591400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 368/730] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:38.592632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.592913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.593193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.610786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6fde6-7192-4eff-bec9-8284f3e5562c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:38.613490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:38.614736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:38.622214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.652205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:38.653632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.654080 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.654412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.655249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:38.655563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:38.657060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d84c0-0403-44c0-bc30-6643af08c7db None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:38.679632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 363/731] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:38.679632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.679632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.679632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.695391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:38.704295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 369/732] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:38.704457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:38.704591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.719723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.773304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 364/733] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:38.773958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.812816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c488b7a-7171-4155-8c91-6b831fe827c8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:38.849686 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:38.850311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.850593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.850875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:38.851568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:38.852959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:38.872783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 370/734] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:00:38 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:38.873697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:38.896506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.907419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eef9c2-d2bc-451e-bffd-18b59eb36505 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:38.962179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:38.982936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:38.983589 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:38.984506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:38.985034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.004735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135777f-50e1-496c-ad8d-258ee7a22ccd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.048065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.049134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.049424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.049703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.061410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:39.067019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:39.068076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:39.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 371/735] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:39.069779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.084471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.086214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.199042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4869-9aac-454d-9204-3feb284cfa67 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.203890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.216099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 365/736] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:00:39.217012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.241699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.249293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.250852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.251285 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.251705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.269011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:39.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:39.277241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:39.278891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:39.286642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 372/737] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:39.286642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.353319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a09b-691f-4ef0-bf44-c0666b40ea93 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.392178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.392894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.393212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.393464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.394191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:39.394502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.396293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.406342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 366/738] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:39.407241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.407663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd536a5-90e3-45ad-8660-043148a297e7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.453780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.455244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.456016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.456540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.470356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.476046 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.478471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:39.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:39.500383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:39.501278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:39.501278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:39.501278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.501278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:39.504299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 373/739] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:39.505497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.524117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb79d3-7175-41e1-aadb-5c0516cda19f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.566493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.567239 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.567557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.568229 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.569087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:39.569433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.571613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.573095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.584518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 367/740] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:39.585439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.634195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297511bf-6d26-4960-bf1e-30ccea81b5a8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.670145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.670803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.671090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.671368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.682176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.683875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-dd0ddc6c-4e43-45b8-8de7-39a0b1869e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:39.698531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:39.699467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:39.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:39.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:39.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:39.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 374/741] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:39.701524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0d55-29b7-4cc3-8fdc-361c32aa3a72 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.701660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0d55-29b7-4cc3-8fdc-361c32aa3a72 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.701942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0d55-29b7-4cc3-8fdc-361c32aa3a72 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.703339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 375/742] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:39.705019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e0d55-29b7-4cc3-8fdc-361c32aa3a72 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.714443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb9834-5588-46e2-9fdc-60f87997e324 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.733160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.754158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.754997 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.755108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.755342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.756035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:39.756379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.757738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.774976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 368/743] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:39.774976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.816460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:39.823628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e0d55-29b7-4cc3-8fdc-361c32aa3a72 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.860446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.861226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.861517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.861798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.874735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.876181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a1989941-fd63-4ee7-a72d-fcb10ded68f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:39.890560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:39.891489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:39.898248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:39.898248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:39.898248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:39.898248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:39.898674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabe67e-3f8e-48d6-9cb8-a7f533be19ca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:39.898808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 376/744] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:39.898808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.898808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.898808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.917237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:39.918447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:39.937939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:39.939063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:39.939505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:39.940060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:39.941367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:39.941835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:39.943826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:39.960285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 369/745] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:39.961718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:39.994896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 377/746] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:00:39.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.011292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.087566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.104172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a39-1ec8-4e00-8806-1ed8b200ca8c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.111528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5a66-943c-45a8-b842-a465227755b5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.147215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.148141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.148608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.149060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.151323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.151888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.152165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.152471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.153659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:40.153961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.155330 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.158651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.160079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.168527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 378/747] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:40.169624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:40.171770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:40.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:40.173587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:40.176736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 370/748] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:40.178621 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.279644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.280238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e623-ed23-4bd1-999b-56bd75ee790f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.286528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c735442-9077-4e5e-9e21-757e89ff29d6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.322247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.322473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.322872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.323159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.323440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.324045 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.324151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.324609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.325689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.326104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.335842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.337559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.339572 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.352298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 371/749] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:00:40 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:40.352298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:40.352606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:40.353627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 379/750] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:40.356018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.475613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddd15b-253e-4cf7-bb8b-c109ce280a9b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.522628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989eb7-b97f-4bbb-92b7-a9e7a7d749ba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.527873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.528762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.529904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.530345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.531247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:40.531734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.533344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.547507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 380/751] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:40.548867 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.564449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.564449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.564719 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.566357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.574555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.576056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:40.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:40.591998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:40.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:40.599560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 372/752] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:40.599560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.618541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.620640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.669666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46b0e-7623-4203-84d1-898587c79a5a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.706512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.707497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.708005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.708509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.709501 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:40.710007 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.711622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.714187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badd93-95ca-4292-b0f8-d333ae6f19ed None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.730788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 381/753] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:40.732763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.752767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.753410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.753700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.753981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.754899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=4fa95647578f48108da5f532c53ae3c1) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:40.755220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.756852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.763446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 373/754] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/role_assignments?user.id=4fa95647578f48108da5f532c53ae3c1&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:40.764318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.854892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.855669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d066ddf-dca1-4a78-92d5-bb706f4f819f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.875061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:40.907545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.908689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.909218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.909698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:40.910739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:40.910951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e496-9a80-470a-b2f5-767aaa324a5c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:40.911454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:40.913291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:40.941432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 382/755] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:40.943277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:40.950004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:40.950654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:40.950942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:40.951219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.052524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.054466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b66f-d408-410e-8c5a-88c2c2ab5f2f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.080328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1a7c8-38fb-4ea1-a45f-d139d37375f2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.120998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.121745 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.122045 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.122324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.134808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.136303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b81fc360-874b-4d8b-a14b-ced9b2f8ed3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:41.167514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:41.169125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:41.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:41.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:41.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:41.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:41.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 383/756] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:41.171045 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1175-e36a-4181-a2e1-882031158655 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.171200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1175-e36a-4181-a2e1-882031158655 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.172401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1175-e36a-4181-a2e1-882031158655 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.174855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 384/757] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:41.177313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e1175-e36a-4181-a2e1-882031158655 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.203592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:41.239895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 374/758] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:00:41.241577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.241876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.242159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.262870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:41.264812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:41.350117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 375/759] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:41.351202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.357229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:41.468220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f96f31-705e-45d2-9b6e-8969100997d8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.472794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e1175-e36a-4181-a2e1-882031158655 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.476916 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:41.506556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.507399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.507754 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.508104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.519095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.520723 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.521225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.521930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.522283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.522893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.524082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:41.524487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.525925 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:41.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:41.544509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:41.545620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:41.545620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:41.545620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:41.545620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:41.546214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 385/760] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:41.546300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 376/761] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:41.546377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.551518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.644577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:41.672476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db70f-0ba0-400a-a59a-d779aaae0b51 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.682566 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7080ee-84eb-4892-81b5-943032b4d589 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.710543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.711362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.711751 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.712129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.712904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.714385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:41.724952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:41.726466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:41.728410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:41.730370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.730370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.730370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.730370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.730942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:41.730942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.735513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 386/762] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:41.735513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.735819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.751858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 377/763] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:41.752820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.780585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:41.864201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a251ef-deff-4b9e-b511-3a6df435a920 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.873724 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706ae6-2d13-4aad-8204-72aa100d5b29 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:41.911177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.911797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.912149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.912555 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.913814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:41.914513 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:41.914799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:41.915078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:41.915825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:41.916137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.917619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.920740 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:41.922451 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:41.923168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 378/764] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:41.924083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:41.943005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:41.945001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 387/765] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:41.946294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:41.957352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.030434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.061772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565866-173d-4c56-8e65-006f68dcabff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.063316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794fa-651a-4bde-a33f-874de3c571a9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.099193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.099887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.100176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.100487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.101363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:42.101594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.103230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.104575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.105627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.105919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.112497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.114152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 388/766] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:42.114940 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.121596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.123107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:42.142552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:42.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:42.144392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:42.148886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 379/767] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:42.150145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.215261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.261547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c719-4201-4514-b014-c245d7f72516 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.267549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330677-d56d-4a8d-908d-e78d14b6d8a0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.297769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.298316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.298601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.298877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.299636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:42.300003 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.301480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.313049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.314182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.314670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.315141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.315926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 389/768] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:42.316293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] RBAC: Adding query filter params (interface=public, service_id=80be5b54b4f94d86ab6ab77dbf8a3297, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:42.316783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.317126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.318533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.329791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 380/769] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/endpoints?service_id=80be5b54b4f94d86ab6ab77dbf8a3297&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:42.331206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.343757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.446225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8235-ef6b-4da7-bf1c-ef845122d390 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.462789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13f84-ca07-4bc1-8ce3-5589d360d4c4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.486652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.487815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.488274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.488969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.491990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=d7b7ff8e53f84c30a43f0f8218ef6d30, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.494315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.495252 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.503787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.504642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.505075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.505442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.506425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:42.506771 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.508463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.514054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 381/770] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:42 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:42.515052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.532299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 390/771] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:42.532299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.608149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:42.658816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20853ee-d96d-4b7f-a46d-c3f75e0c69ad None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.709369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.710512 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.710946 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.711368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.711995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88b2ec-22ec-437e-b5ac-0280dbe3f959 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:42.712750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.716233 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734783b-c237-42d0-8d23-b1646044caaf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.724078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 382/772] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:42.726391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb089b-c237-4ea7-9f5e-2c3cb5ecebf1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.726835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb089b-c237-4ea7-9f5e-2c3cb5ecebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.727300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb089b-c237-4ea7-9f5e-2c3cb5ecebf1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.730030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 383/773] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:42.737180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.737703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.738342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.759019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:42.759951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:42.760424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:42.760802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:42.761798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1b4dc0771b604dfbb30663d5374bcf69) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:42.762225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:42.763895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:42.765081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:42.766788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 391/774] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/role_assignments?user.id=1b4dc0771b604dfbb30663d5374bcf69&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:42.853891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 384/775] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:42.878902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:42.952783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.006370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42715306-084e-4376-92e0-0052d8eecefd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.045087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.045747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.046026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.046298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] PATH_INFO: `/v3/services/network` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.046930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:43.048308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6f2aec78-6ecb-45f6-b239-be6a5e94f095 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:43.063929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:43.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:43.065807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 392/776] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:42 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:43.073139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.114040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3093e-14b6-4f0a-8c37-04e0c0df1772 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.114359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3093e-14b6-4f0a-8c37-04e0c0df1772 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.114579 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3093e-14b6-4f0a-8c37-04e0c0df1772 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.116070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 393/777] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:43.122644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.122644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.122644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.146537 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:43.147353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.148320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:43.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f83c-cf12-4404-b1cd-f9b337b0a0f9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.260510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 394/778] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:43.279200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.305600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.306246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.306535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.306818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.307768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:43.308078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:43.309532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:43.320350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 385/779] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:43.323641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.370374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.480769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e6d42-7e8e-46c4-a1db-0dfca846a227 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.494424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563be8-dad1-4fdf-bec9-d12caad3d7b1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.523591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.538785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.539426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.539716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.539998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.544456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:43.544778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:43.548765 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:43.557897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 386/780] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:43.559451 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.560109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.560436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.560717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.563285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.584570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:43.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:43.596109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:43.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 395/781] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:43.605253 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.707341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54c1c-1c0d-4dac-a243-09d0f5428aa7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.748361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.749157 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.749445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.749725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.750492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] RBAC: Adding query filter params (interface=public, service_id=523df1c2975e4e828d96a561e6f509e2, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:43.750809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:43.752278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:43.759521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 387/782] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/endpoints?service_id=523df1c2975e4e828d96a561e6f509e2&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:43.765300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:43.854329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782119c-b6cb-44ec-8a5d-77a2da11deff None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.862860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.873979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:43.928945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:43.929910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:43.930201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:43.930481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:43.931209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:43.931518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:43.934664 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:43.937972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cc87-30a3-4c94-b34e-177896764b4f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:43.956433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 396/783] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:43.962034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:44.018812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:44.019372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:44.019656 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:44.020637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:44.021314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:44.022693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:44.035084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 388/784] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:44.099032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829ff0-f58d-487c-a933-b631fb0fd695 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:44.144199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:44.144902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:44.145182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:44.145455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:44.166848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:44.168369 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:44.194183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:44.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:44.196491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:44.196491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:44.196491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:44.196491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:44.196491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 397/785] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:44.201555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:44.351156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1615-6a98-44b4-b1c4-1fc831d8b634 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:44.374182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:44.401054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:44.401688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:44.401979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:44.402260 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:44.403010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:44.403322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:44.404720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:44.421888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 389/786] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:44.427026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:44.479254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:44.581060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ea39-49b0-4e71-908e-f9af99edd183 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:44.642058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:44.642630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:44.642916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:44.643194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:44.653674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:44.655142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:44.667245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:44.668280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:44.669290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 398/787] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:44.677158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:44.823580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763acf5-d6e3-48a4-b6ac-b3a5f0789a58 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:44.865508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:44.866142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:44.866428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:44.866710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:44.867510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:44.867823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:44.869338 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:44.893072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 390/788] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:44.898577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.010127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.038497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa111-f28c-43f2-a6f6-1bd1ee0660fb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.084951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.085608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.085894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.086171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.098187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:45.099654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2ea03bd2-d965-4405-8bc1-fc281d7ca216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:45.117372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:45.118323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:45.119323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:45.119323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:45.119323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:45.119323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:45.124736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 399/789] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:45.130335 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.218709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.222370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c313-fda7-475e-89eb-8f070c5f2801 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.222809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c313-fda7-475e-89eb-8f070c5f2801 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.223125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c313-fda7-475e-89eb-8f070c5f2801 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.224755 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 400/790] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:45.233004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a1e6-9472-4149-a4d0-ea10c6d85678 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.233294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a1e6-9472-4149-a4d0-ea10c6d85678 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.233582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a1e6-9472-4149-a4d0-ea10c6d85678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.269630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-88e9a1e6-9472-4149-a4d0-ea10c6d85678 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:45.272110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-88e9a1e6-9472-4149-a4d0-ea10c6d85678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:45.322963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99065a-e7af-456e-b1b1-2e483d60ad68 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.367382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 401/791] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:45.374242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.374242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.374242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.374242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.374630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:45.374630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:45.374630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:45.376505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b23b4f-31e3-438f-bec8-026d78bc4719 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.377463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b23b4f-31e3-438f-bec8-026d78bc4719 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.377926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b23b4f-31e3-438f-bec8-026d78bc4719 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.379696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 402/792] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:45.383217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b33f-abe9-4d65-9252-0ad40bf3590e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.384245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b33f-abe9-4d65-9252-0ad40bf3590e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.384760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b33f-abe9-4d65-9252-0ad40bf3590e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.386902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 403/793] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:45.388982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f816-9867-420f-a602-c94586517f7f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.389527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f816-9867-420f-a602-c94586517f7f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.390023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f816-9867-420f-a602-c94586517f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.390547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 391/794] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:45.397121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.415606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7b95f816-9867-420f-a602-c94586517f7f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:45.417306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7b95f816-9867-420f-a602-c94586517f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:45.480146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.494209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 404/795] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:45.497204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.501705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.502052 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.502404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.504984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f117-472e-405a-90c0-d45320d4b57c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.529546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:45.530894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:45.542771 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.543558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.544368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.544649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.551657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:45.553147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:45.565376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:45.566315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:45.567186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 392/796] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:45.568391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.618368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 405/797] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:45.619281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.688382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000eb9-94ee-4ffe-9dcb-675598b68bf6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.730300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.730875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.731237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.731515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.739485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb0c25-5092-41fd-a7f0-58eaf0af625a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.744812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:45.750339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:45.751253 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:45.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 393/798] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:45.753242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.770196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.772663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:45.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.785111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.785402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.785819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.797389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:45.802345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:45.803242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:45.804072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 406/799] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:45.805308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.872092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfcc6d-0eba-430e-93a8-52b2654f9d3d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.914366 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.915000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.915288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.915387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521317d-5460-4f1e-9c30-55056c5160ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:45.915798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.916373 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:45.916688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:45.918131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:45.933370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 394/800] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:45.937264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:45.961300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:45.961951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:45.962248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:45.962969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:45.963114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:45.964525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:45.975081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:45.976070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:45.983903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 407/801] 10.222.0.40 () {56 vars in 1129 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:45.984806 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.040112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.048772 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.070229 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc9714-ad6e-4895-b3d7-a419f4a1a925 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.105718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.106431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.106715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.109842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.109967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7796a2-dca6-400b-8a81-0280f15bd9ef None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.110069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.110069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.110069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.122865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 395/802] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.124786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.149721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.150348 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.150640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.150915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.151640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.151946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.153397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.166473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 408/803] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.167355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.235850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebc6b-196b-4c1b-9fe3-8de7e57d8005 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.272421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f3dfc-5175-4cbc-96a6-03b6182b51a0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.273464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.274149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.274436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.274722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/4fa95647578f48108da5f532c53ae3c1/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.276712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=4fa95647578f48108da5f532c53ae3c1, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.278704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.282646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.284799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.295783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 396/804] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:46 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/4fa95647578f48108da5f532c53ae3c1/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:46.296642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.317100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.318006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.318456 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.318998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.319852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.320432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.322154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.329346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 409/805] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.330577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.468227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd1af-9bfb-4e24-81d3-19917ca96485 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.473536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0fac-372c-4d44-a8ec-f2899bbc65d6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.514218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.514789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.515031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.515160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.515319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.515702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.515990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.516317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.527485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.529734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.529845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.531206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:46.544600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:46.545662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 410/806] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:46.547249 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1c27a241-1349-4072-aa0a-74f13494acf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:46.553375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:46.554845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 397/807] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d06-055a-42f4-844b-93ef81712b0c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d06-055a-42f4-844b-93ef81712b0c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612d06-055a-42f4-844b-93ef81712b0c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.556102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 398/808] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:46.559954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612d06-055a-42f4-844b-93ef81712b0c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.580229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.617294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.662934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989a72-38d7-4fc7-af57-69799ff49858 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.674742 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612d06-055a-42f4-844b-93ef81712b0c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.701241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.702358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.702793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.703333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.704511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.705235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.707222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.711635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.712288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.712584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.712865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.713568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.713885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.719543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5944-d82c-4034-bed3-916165a6aa09 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.719696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 411/809] 10.222.0.40 () {56 vars in 1124 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.719696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.730107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 399/810] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.734758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.734758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.734758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.752177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:46.753414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:46.815383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.826365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5c09d-6f15-4650-b2bd-c78d2145ca73 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.829435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 400/811] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:46.830561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.871085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:46.879775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88277347-89cb-4329-b487-0ac595373472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.880712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277347-89cb-4329-b487-0ac595373472 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.881006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277347-89cb-4329-b487-0ac595373472 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.881289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277347-89cb-4329-b487-0ac595373472 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.882159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88277347-89cb-4329-b487-0ac595373472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:46.882476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88277347-89cb-4329-b487-0ac595373472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.884172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88277347-89cb-4329-b487-0ac595373472 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:46.901992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 412/812] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:46.903981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88277347-89cb-4329-b487-0ac595373472 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:46.944841 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019c7e-1174-4f19-afc0-70718a5ee6f5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:46.985900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:46.986539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:46.986822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:46.987101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:46.987845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:46.989267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.014697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 401/813] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:00:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:47.015776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.034668 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88277347-89cb-4329-b487-0ac595373472 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.102726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.103660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.104101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.104557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.115159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.117556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:47.134158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:47.135231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:47.140705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 413/814] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:00:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:47.141993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.142760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.155120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28dba3-f095-40d9-8569-ac0276da1a41 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.157646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.202059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.203001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.203438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.203874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] PATH_INFO: `/v3/services/network` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.205541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.207202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:47.222911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:47.223966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:00:47.224850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:47.228675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 402/815] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:47.230506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.284474 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294454-1484-4f4c-a4f2-e82cabaf024b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.329448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.330492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.330778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.342004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.344312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.346411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578263-bb51-4426-918e-9a5315466a06 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:47.359485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:47.360651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:00:47.361591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:47.364620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 414/816] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:47.365257 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.393642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.394303 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.394604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.394872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.395685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:47.396109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.397704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.417653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 403/817] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:47.418532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.439093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.467988 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.519124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c8bc-d269-409f-b8c9-a0d2abd806b4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.534625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd23fe7-3f81-40d3-8d11-1ae883ce6161 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.565860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.566854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.567231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.567881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.568903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] RBAC: Adding query filter params (name=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:47.569222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.570613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.575886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.576170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 415/818] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:47.577014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.580798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.581085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.581359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.582176 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:47.582483 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.583920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.608805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 404/819] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:47.608805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.688318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.713767 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f14dc-be9b-44f3-95a8-d6aa2d945029 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.717975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f58023-4d02-4db1-8d3e-e071e3d46efa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.745786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.752765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.753516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.753809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.754081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.758866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.759745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.760228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.760730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.761740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:47.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.764042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.765291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.766967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.774963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 405/820] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:47.776338 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:47.783298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:47.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:47.785522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:47.785522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:47.785522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:47.785522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:47.789238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 416/821] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:47.790380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:47.890964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f9ab-5874-4934-aebe-f3e34fc7ab4c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.903361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91590c23-13b1-4816-a776-7c62d810c5fb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:47.929351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.930356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.930844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.931421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.941048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:47.941606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:47.941890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:47.942222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:47.942972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:47.943915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:47.945057 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:47.976008 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 417/822] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:00:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:47.976008 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.065517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.066396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.067014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.210238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac666-8dfa-4fa9-adad-824e9e71d67c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.262574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.263806 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.264660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.265366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.266347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:48.266872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.268540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.272376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 406/823] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:00:48.273870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.286297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 418/824] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:48.293036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.326620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.408976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ff4a7-0a59-4c05-a493-806cfb65df87 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.421389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.430304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4defdc-55e8-4a13-95fc-8acc3822751d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.444753 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.445400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.445682 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.445957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.457544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.459338 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.470243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.470822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.471105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.471381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-db97f296-9ce1-456e-807f-e79fcce505d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:48.475517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:48.476431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:48.477336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:48.477336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:48.477336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:48.477336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:48.477336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 407/825] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:48.478218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a93e5-6c29-4ae2-a1b8-9400ef8d64af None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.478505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a93e5-6c29-4ae2-a1b8-9400ef8d64af None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.478780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a93e5-6c29-4ae2-a1b8-9400ef8d64af None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.480147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 408/826] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:48.483238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.484868 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.484971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a93e5-6c29-4ae2-a1b8-9400ef8d64af None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a5f9816c-61c3-4087-aa39-4160455203e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:48.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:48.498983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 419/827] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.502604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.504135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.521233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:48.522436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:48.594121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.600674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 420/828] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:48.601558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.612359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a93e5-6c29-4ae2-a1b8-9400ef8d64af None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.651933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.652587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.652904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.653167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.653860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:48.654164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.655521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.672981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 409/829] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:48.672981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.695705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.713639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da473ff-00f1-448d-a4fa-626ea89578de None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.749269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.749894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.750142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.750352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.751106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:48.751523 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.752994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.766057 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 421/830] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:48.766677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.788057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ee4c-9bad-4aac-90ba-2c8f07dec92a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.825297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.825950 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.826231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.826507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.836599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:48.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:48.842467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:00:48.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:48.848728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 410/831] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:48.849745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.865887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.880789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573dbc1-3e25-4613-bc78-bf3b5d7949d3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:48.921888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:48.922679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:48.923028 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:48.923488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:48.930308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:48.931826 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:48.943436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:48.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:48.945535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 422/832] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:48.946024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:48.954552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:48.969652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c9b69-1fe0-4e31-9867-7baaeb315626 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.006950 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.007559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.007830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.008106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/1b4dc0771b604dfbb30663d5374bcf69/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.023582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=1b4dc0771b604dfbb30663d5374bcf69, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.039416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 411/833] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:00:48 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/1b4dc0771b604dfbb30663d5374bcf69/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:00:49.041538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.060071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab6f3-d68d-4687-aefe-ccc2b718444d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.103025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.104000 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.104320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.105704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:49.105704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.110139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.123613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 423/834] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.144656 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.198745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcec6c-9c9d-4039-973e-63b4ca29a326 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.202087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.241493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178ba55-71e5-43b7-84ff-1e1106eaa375 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.243048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.243680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.243977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.244275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.245092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:49.245406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.247381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ef959-f5d5-449e-bcd0-8418feb19a6e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.260633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 412/835] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:49.262795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06059ee2-bb6a-4d46-877f-26c2493a7dd0 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.263297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06059ee2-bb6a-4d46-877f-26c2493a7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.264398 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06059ee2-bb6a-4d46-877f-26c2493a7dd0 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.266220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 413/836] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:49.267868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06059ee2-bb6a-4d46-877f-26c2493a7dd0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.278698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.279792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.280085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.280401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.292481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.293972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a33705fe-02dd-4128-8098-0f0a64db9e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:49.310133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:49.311077 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 424/837] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.317168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.333639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:49.334838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:49.385089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06059ee2-bb6a-4d46-877f-26c2493a7dd0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.404763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 425/838] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:49.405899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.415881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.433152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.433993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.434364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.434715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.435519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:49.435941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.437583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.443994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 414/839] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:49.444810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.468193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.534565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdd928-de9e-4bb7-8126-f6bc2a7bbf74 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.573598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.575213 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.575644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.576435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.577605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:49.578320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.580676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.581928 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9972-1afb-4c49-84cd-b2729d17ce18 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.600684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 426/840] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:49.602107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.635780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.636529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.636820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.637611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.638304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.639793 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:49.651759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:49.653588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:49.654618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:49.655579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 415/841] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:49.661444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.727111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.758461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63b59d-7bf8-40e2-9033-1591ed39161a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.772280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:49.801956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.802703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.802823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880c6a-0642-449a-a676-4879b611d71f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.803183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.803562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.812698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.814356 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:49.827529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:49.828722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:00:49.829869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:49.836196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 427/842] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:49.837258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.845542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:49.846187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:49.846480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:49.846759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:49.847450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:49.847759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:49.849756 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:49.857638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 416/843] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:49.863214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:49.962883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82694-d16b-4db6-b8e9-7f2d0c2abcc9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:49.986393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b7d0c-8f3c-4af1-87f3-1f80d02890e5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:50.000540 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:50.002881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.003744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.004227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.004722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.005742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:50.006224 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.007823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.025419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.026123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.026417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.026702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.027400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:50.027743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.029122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 428/844] 10.222.0.40 () {56 vars in 1135 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:50.029231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.034291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:50.038521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 417/845] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:50.068631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:50.187117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347834e-02ce-4670-8cc1-4ee25f8881ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:50.230859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.231689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.231959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.304021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.305511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.333287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:50.410309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 429/846] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:00:50.416422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:50.532170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de066f-1dfd-4ce0-a246-a585c873f09b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:50.571376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.572120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.572501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.572843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.584983 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.586451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:50.601436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:50.602559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:50.603675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:50.603675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:50.603675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:50.603675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:50.605082 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 418/847] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:50.613389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:50.722634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c3b3-98db-4626-8ed6-39ccfca7de0a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:50.752665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:50.760832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.761846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.763040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.763322 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.764084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:50.764452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.765948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.778346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 430/848] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:50.784113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:50.816001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:50.894028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3362-a76e-4bf1-a0fe-626fa6812467 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:50.930190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:50.930854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:50.931138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:50.931415 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:50.938996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:50.940550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:50.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:50.954069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:50.954955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 419/849] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:50.960435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.068787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb25-b2ae-4e65-a756-ebbcf06009ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.104323 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.104957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.105236 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.105512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.106807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:51.107114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.108612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472cb04-91fd-4a9c-95e1-f37b61602748 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:51.122247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 431/850] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:51.127905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.130808 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d29b-fb0a-419a-8fbd-b553edb6a324 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.131316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d29b-fb0a-419a-8fbd-b553edb6a324 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.132029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d29b-fb0a-419a-8fbd-b553edb6a324 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.134874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 432/851] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:51.141694 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.142209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.142666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.161233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:51.162838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:51.208788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.220766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.235568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a6ab-045a-4268-85e7-5d71582790f8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.244395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 433/852] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:51.261451 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.271748 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.272415 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.272699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.272972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.274222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=4fa95647578f48108da5f532c53ae3c1) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:51.274334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.275992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:51.282714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 420/853] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/role_assignments?user.id=4fa95647578f48108da5f532c53ae3c1&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:51.383628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61f6d-300b-4e65-8d27-281ae1a04ac9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.423804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.424850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.425318 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.425780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.438572 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:51.444127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:51.445051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:00:51.445897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:51.448283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 434/854] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:51.454678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.563476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1b7c-a1b0-4f35-8811-3b3af8c7ef23 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.601131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.601769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.602099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.602385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.603112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:51.603421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.604906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a974c-f500-4e4d-ae24-42d1293ac107 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:51.613903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 421/855] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:51.619415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.636856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe92d8-1ab9-48b1-bdb6-75c1f288b5f1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.637686 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe92d8-1ab9-48b1-bdb6-75c1f288b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.637975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe92d8-1ab9-48b1-bdb6-75c1f288b5f1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.639587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 422/856] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:00:51.644500 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.644795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.645074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.660291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.667440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:51.669091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:51.684341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.744479 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4249-8d64-4f68-9fd6-8a8ab8f32296 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.768691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 423/857] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:51.786424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.787180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.787472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.787753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.790465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.802376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.804933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:51.826703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:51.827661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:51.828605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:51.828605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:51.828605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:51.828605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:51.832296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 435/858] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:51.836388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.912152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beae92-a3fe-488d-b1d1-89ba949e0f6a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.930174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.943827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4151ac6-d46e-4f35-8f72-4a398804f9da None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:51.954435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.955342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.955810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.956416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.957207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.958760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:51.969639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:51.970822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:51.971832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:51.974613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 424/859] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:51.980739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:51.992568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:51.993309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:51.993658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:51.994002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:51.994736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:51.994847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:51.995137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:51.997138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.014524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 436/860] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:52.015530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6ae0-a3ab-4351-8ca7-c8b617d9abec None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.123647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5978ba-fcc1-49a3-8bfc-515c74334013 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.140498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.141584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.142218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.142806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.143751 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:52.144363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.146163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.152201 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 425/861] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:52.158339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.170590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.171247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.171528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.171810 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.181760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.184859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:52.202124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:52.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:52.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:52.208112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 437/862] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:00:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:52.210159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.224468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:52.258970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:52.296814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913ea8-63c3-4835-acb9-aab21a58f882 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.331818 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c02e0-34cd-4814-b75e-f6f3a304799d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.333361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.333922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.334208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.335111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.335232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:52.335471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.336877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b3641-5128-4dba-aa2c-b3ccd0b8bb7f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.342316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 426/863] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:52.343327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0e92-3c7f-46e1-88e0-ab0d1a304dd5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.343616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0e92-3c7f-46e1-88e0-ab0d1a304dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.343894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0e92-3c7f-46e1-88e0-ab0d1a304dd5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.349152 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 427/864] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:52.350796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.351087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.351365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.371800 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:52.372893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:52.392720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.394087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.395047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.395543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.396622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:52.397170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.399985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.425027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 438/865] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:00:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:52.430923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.472345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 428/866] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:52.493159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.536439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:52.587887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463c61a-acfd-48a4-8cdc-9aa41eef0234 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.597084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:52.633171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.634070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.634429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.635073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.641552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4a526-dc76-4f37-9da2-9bf5a6a009eb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:52.685546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:52.686584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:52.687091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:52.687617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:52.688992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.690945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.712210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 429/867] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:00:52 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:00:52.724896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:52.726540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:52.806499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:52.855027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 439/868] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:00:52.860491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:52.982249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9bd-4b65-4c77-b6a8-f29ada2ebfdf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.010461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:53.024058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.024827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.025109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.025385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.035890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.037394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:53.052237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:53.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:53.054207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:53.054207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:53.054207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:53.054207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:53.054207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 430/869] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:53.060053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.167347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95ad1-1f8b-4510-9163-ced42b34bbb6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.202804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.203430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.203710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.203980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.204702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:53.205005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.206363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.218370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 440/870] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:53.223929 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.328772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed3814-b109-412f-a670-1b632d45d831 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.363277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.363942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.364228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.364535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.371493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.372979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a0339d38-f582-4104-9e49-b3fd5ce98162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:53.385032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:53.385936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:53.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 431/871] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:53.392470 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.420674 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:53.462113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7d92-c5e3-4fc9-8ef8-54cd1e25f02a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.462557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7d92-c5e3-4fc9-8ef8-54cd1e25f02a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.462940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7d92-c5e3-4fc9-8ef8-54cd1e25f02a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.464643 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 432/872] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:53.471081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.471362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.471636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.490108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:53.491401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:53.510250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e465a0-a730-4bcb-9b7a-e9f7c6c6a7b0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.522428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:53.549450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.550447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.550926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.551394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.552479 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:53.553005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.554809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.568330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 433/873] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:53.574314 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 441/874] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:53.584385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.592906 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.686335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:53.690612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d78e-2567-4152-a27d-395a30464151 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.696186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776051-a568-42ac-b304-0c72db98de25 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.726795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.727570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.727952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.728438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.729331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1b4dc0771b604dfbb30663d5374bcf69) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:53.729756 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.731531 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.732413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.733212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.733636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.734070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.734834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.736419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.744286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 434/875] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/role_assignments?user.id=1b4dc0771b604dfbb30663d5374bcf69&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:53.754518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:53.755797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:53.756721 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:53.757742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 442/876] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:53.764095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:53.799989 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:53.882045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573148-2137-4fce-ae51-bd50e7e5d289 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:53.919925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:53.920642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:53.920925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:53.921200 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:53.921935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:53.922245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:53.923609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162c12-dc62-4255-a4a3-1fd10227e397 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:53.929767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 435/877] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:53.936560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:54.050924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e3a9-2a0f-4819-90c5-ae4d6b0701b2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:54.086879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:54.087507 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.087789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.088063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.088778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:54.089084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:54.091108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f70209-1084-4248-b675-67b3b6515119 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:54.096330 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 443/878] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:00:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:54.426088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00de3-737b-4904-b910-23df0062335b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.426438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00de3-737b-4904-b910-23df0062335b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.426661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00de3-737b-4904-b910-23df0062335b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.428282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 436/879] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:54.434523 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954dfc-da6b-4a72-92ae-3274b1a55d28 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.434995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954dfc-da6b-4a72-92ae-3274b1a55d28 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.435072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954dfc-da6b-4a72-92ae-3274b1a55d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.453920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5e954dfc-da6b-4a72-92ae-3274b1a55d28 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:54.455127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5e954dfc-da6b-4a72-92ae-3274b1a55d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:54.466149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:54.530156 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 444/880] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:54.552704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00de3-737b-4904-b910-23df0062335b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:54.656163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:54.666787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00de3-737b-4904-b910-23df0062335b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:54.703371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:54.704376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.705068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.705580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.706536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:54.708112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ae293-6955-4a34-be20-585285cb28d0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:54.725267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 437/881] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:00:54 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:54.943666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4cb4c-2896-4d73-8d67-93b6b1af5790 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.944041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4cb4c-2896-4d73-8d67-93b6b1af5790 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.944238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4cb4c-2896-4d73-8d67-93b6b1af5790 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.945875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 445/882] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:54.951224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:54.951528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:54.951980 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:54.975232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:54.976387 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:55.052218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 438/883] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:55.074769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4cb4c-2896-4d73-8d67-93b6b1af5790 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:55.187296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4cb4c-2896-4d73-8d67-93b6b1af5790 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:55.223591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:55.224316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:55.224604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:55.224880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:55.225619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:55.226935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:55.236602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:55.237646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:55.238493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 446/884] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:55.245746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:55.328892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:55.351888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c03d-40c5-472b-99a3-39d92ce02672 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:55.385829 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:55.386463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:55.386746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:55.387551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:55.388244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:55.388576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:55.389942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:55.395133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 439/885] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:55.400733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:55.412517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:55.507213 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0e95-8827-4c47-bbd0-c69b995f8198 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:55.542390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:55.543028 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:55.543841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:55.544120 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:55.544845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:55.545209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:55.546707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:55.552017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 447/886] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:55.558380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:55.662646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4235-ded0-4751-bf76-ee082981105a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:55.698733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:55.699911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:55.700214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:55.700525 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:55.701349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] RBAC: Adding query filter params (interface=public, service_id=37764014f46545509f6a30efc314d1ab, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:55.701663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:55.703087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cd08-0aa1-45ee-955a-4229051ac54b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:55.709106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 440/887] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:00:55 2022] GET /identity/v3/endpoints?service_id=37764014f46545509f6a30efc314d1ab&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:55.715168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:55.792217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:55.824594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8604cf1-6afc-48b1-9eff-27fd21fe9acb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:55.861608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:55.862261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:55.862549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:55.862828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:55.863500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:55.864909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fbc6f-a2b7-493d-b4ab-5924a642e17f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:55.872039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 448/888] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:00:55 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:00:56.037741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ab20-b05e-4ba1-abc6-ffb2239958f3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.038094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ab20-b05e-4ba1-abc6-ffb2239958f3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.038312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ab20-b05e-4ba1-abc6-ffb2239958f3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.039945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 441/889] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:56.045897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce03d-3c96-4c66-9f63-5fe86ffae524 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.046248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce03d-3c96-4c66-9f63-5fe86ffae524 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.046654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce03d-3c96-4c66-9f63-5fe86ffae524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.066054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0d5ce03d-3c96-4c66-9f63-5fe86ffae524 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:56.067264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0d5ce03d-3c96-4c66-9f63-5fe86ffae524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:56.139780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 449/890] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:56.163179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46ab20-b05e-4ba1-abc6-ffb2239958f3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.173062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:56.268872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46ab20-b05e-4ba1-abc6-ffb2239958f3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:56.291912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd63a-1518-4d1b-89c9-24410144308f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.292211 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd63a-1518-4d1b-89c9-24410144308f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.292505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dd63a-1518-4d1b-89c9-24410144308f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.298368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 450/891] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:56.299974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.300409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.300696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.303750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:56.304731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.305208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.305620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.317121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:00:56.320349 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:56.321563 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:00:56.322636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:56.323740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:00:56.325203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:56.327949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 442/892] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:56.337348 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.401490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:56.406932 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 451/893] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:56.428508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:56.429133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.455282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885a44-ff66-4471-91af-0fdebfa7e78e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:56.493169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:56.493737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.494025 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.494306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.495023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:56.495341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:56.497426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:56.510678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 443/894] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:56.513033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.565106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc513-b1c0-48be-a403-71ac78324442 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:56.610759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:56.611970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.612475 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.613855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:56.615553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:56.628420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4417779-0145-4c01-80c3-fd1a934cf839 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:56.644284 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 452/895] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:00:56 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:00:56.667965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:56.683804 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:56.684511 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.684801 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.685078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.698948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:56.700669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-bc066e78-96ac-47b9-be6f-f90b2d4c3405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:56.718863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:56.719826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:56.720961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:56.720961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:56.720961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:56.720961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:56.720961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 444/896] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:56.729493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.798078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:56.836049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f2fe-1b06-431d-87f8-efa9a7d79107 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.836383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f2fe-1b06-431d-87f8-efa9a7d79107 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.836668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9f2fe-1b06-431d-87f8-efa9a7d79107 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.838140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 445/897] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:56.844865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.845563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.849266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e511e6-37db-4a6d-a171-eaddbaf24f32 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:56.872371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:56.873596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:56.901370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:56.902109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:56.902397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:56.902704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:56.903412 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:56.903720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:56.905312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:56.924457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 453/898] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:56.926058 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:56.970375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 446/899] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:00:56.993324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.053336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498b8d6-9167-47c2-974c-cd99bb86ec6e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.072869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.095706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.096757 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.097248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.097733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.106778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.108588 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:00:57.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:57.123261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:00:57.124174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:57.124718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9f4f-4461-4277-b382-319d69621412 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.126890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 454/900] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:57.130493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.132619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.172281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.172987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.173276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.173552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.174190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.176843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:57.192121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:57.193126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:57.193965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 447/901] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Jul 31 01:00:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:57.199581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.265810 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332a27-49ee-434c-a04f-d384bdfb923e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.311892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.312634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.312836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.313110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.313968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:57.314363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.315760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.320749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b73-6ce3-4e3a-baaf-ed3270ad5480 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.334234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 455/902] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:57.340907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.361017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.361748 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.362105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.362539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.363294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:57.363714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.365234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.375818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 448/903] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:57.376954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.379094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.414159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.454909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c8d7-f5dd-48a8-a025-a7a176942461 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.483205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb41e-884f-4ba8-a7fa-182d00660b3b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.492057 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.493128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.493684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.494209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.522146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.522919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.523276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.523622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.524429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:57.524795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.526349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.537215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 449/904] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:57.538530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.587582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.590865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.635947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.654960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.660963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da652-92ad-49b4-b21a-82ecccb93923 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.717592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.718231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.718516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.718792 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.719555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] RBAC: Adding query filter params (interface=public, service_id=7722f5e41d394cb4a7ae32849c57489e, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:57.719866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.721270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.727098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 450/905] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/endpoints?service_id=7722f5e41d394cb4a7ae32849c57489e&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:57.733504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.736170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 456/906] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:00:57.741768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.849792 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912c6d-d0bb-4487-ae78-8e8a61ecc29c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.849991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8443974-9320-437b-b34c-ae7df933477c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:57.887988 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.888632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.888919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.889196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.889600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:57.890603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:57.891088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:57.891466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:57.891742 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:57.892717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.894535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.901907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 451/907] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:00:57.903366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:57.908295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b95a7d95-047c-4ba1-8e98-56accc1b70fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:00:57.926920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:57.927918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:57.928859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:00:57.928859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:00:57.928859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:00:57.928859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:57.936241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 457/908] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:57.937993 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:57.972377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.056781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0d4a-242a-4f41-89f1-f7b7c3d6317c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.058301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa18d-9720-47e5-9275-918909d6289d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.058595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa18d-9720-47e5-9275-918909d6289d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.059385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa18d-9720-47e5-9275-918909d6289d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.061853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 458/909] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:58.066944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.067233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.067512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.090646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:58.091855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:58.094973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.095617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.095906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.096184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.096918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:58.097226 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.098598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.112845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 452/910] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:58.119624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.192807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 459/911] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:58.209282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.215552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.229841 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa6972-76b6-48c9-8834-d3ae5a28b3cb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.267583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.268241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.268552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.268835 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.276300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.278438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:00:58.290933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:58.291882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:58.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 453/912] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:58.298810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.328930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98775a-5503-4069-9e69-d2fa3c3e792a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.354501 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.380229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.380911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.381215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.381467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.382101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.383481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:58.399104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:58.400190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:00:58.401064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:00:58.404173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 460/913] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:00:58.412303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.433158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10f85f-d853-49a3-a2b0-f06047786112 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.468302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.468920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.469205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.469485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.470242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:58.470552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.471985 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.491249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 454/914] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:58.492641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.502050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.530334 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0f15-4cb4-4e26-8522-e26558d1944c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.567906 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.569086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.569627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.570108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.571001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:58.571509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.573432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.583874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 461/915] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:58.589881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.617888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995eaa-1911-4786-b2cc-02263b4a01f4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.658355 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.659019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.660094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.661415 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.662051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.663078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] RBAC: Adding query filter params (role.id=4614644ededa4bab99725c11d75162ff, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1b4dc0771b604dfbb30663d5374bcf69) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:58.663747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.665619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.672533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 455/916] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/role_assignments?user.id=1b4dc0771b604dfbb30663d5374bcf69&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=4614644ededa4bab99725c11d75162ff => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:00:58.735812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e16ec-03a0-454d-ae80-c2ed6c7bf294 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.784460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.785226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.785516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.785824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.786587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:58.786892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.788351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dd31-697f-4233-827f-c89a748a2692 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.795044 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 462/917] 10.222.0.40 () {56 vars in 1114 bytes} [Sun Jul 31 01:00:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:58.801758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:58.881180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:58.913444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc45fe-fd99-4720-abb2-1502a53a9608 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.913758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc45fe-fd99-4720-abb2-1502a53a9608 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.914020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc45fe-fd99-4720-abb2-1502a53a9608 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.917859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f463-02bb-41d3-b5c4-c2a93c35f3ba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:58.920287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 463/918] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:00:58.923094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.923389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.923671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.948207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:00:58.949922 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:00:58.957291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:58.958267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:58.958809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:58.959330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:58.960298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:58.961773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:58.985681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 456/919] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:00:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:00:59.052498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 464/920] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:00:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:00:59.068781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:59.201702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c300b-615e-43f4-9c2f-ab654e44418d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:59.231052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:59.243875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:59.244570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:59.244860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:59.245146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:59.245785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:59.247283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:00:59.256633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:00:59.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:00:59.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:00:59.260303 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 457/921] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:00:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:00:59.264776 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:59.313895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:59.372710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bedc7f-e618-4aa5-8fb5-3b04af72fc6f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:59.409543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:59.410180 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:59.410472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:59.410754 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:59.411511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:59.411829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:59.413313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:59.423203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 465/922] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:00:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:59.424580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:59.533330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491a4d-43d8-44dc-88c5-16b7f3ba0226 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:59.570105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:59.571073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:59.571581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:59.572079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:59.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:59.573497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:59.575126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:59.581185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 458/923] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:00:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:59.587435 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:59.699540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5eda6-ccbc-45c6-98a5-68df3a6d9f77 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:59.701447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:59.742196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:59.742920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:59.743216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:59.743537 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:59.744347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] RBAC: Adding query filter params (interface=public, service_id=5d88c629f57d463da22351e21ca6feb2, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:00:59.744666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:59.746069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88b8e-3fa7-46be-89f4-25545de8e660 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:59.754226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 466/924] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:00:59 2022] GET /identity/v3/endpoints?service_id=5d88c629f57d463da22351e21ca6feb2&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:00:59.759573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:00:59.819849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:00:59.870913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b5d0-9236-4e90-969c-02ed9777a11b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:00:59.916642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:00:59.917716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:00:59.918740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:00:59.919251 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:00:59.920120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:00:59.921709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72418516-0ca7-46a7-a5c1-7b69d6afab5f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:00:59.928789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 459/925] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:00:59 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:01:00.075322 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120debcc-eda6-4d8b-be34-e7dcb7e2263b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.076111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120debcc-eda6-4d8b-be34-e7dcb7e2263b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.076646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120debcc-eda6-4d8b-be34-e7dcb7e2263b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.078517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 467/926] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:00.084397 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.085027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.085521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.106141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:00.107782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:00.183308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 460/927] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:00.206971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120debcc-eda6-4d8b-be34-e7dcb7e2263b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:00.319413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120debcc-eda6-4d8b-be34-e7dcb7e2263b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:00.355333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:00.356060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.356392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.356676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.357382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:00.358867 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:00.368742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:00.369792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:00.370930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 468/928] 10.222.0.40 () {56 vars in 1132 bytes} [Sun Jul 31 01:01:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:00.379130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:00.431367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:00.486910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387e2d-6d96-4e10-af2c-d8c62ef50840 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:00.523416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:00.524495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.525004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.525499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.526400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:00.526921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:00.529067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:00.539146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 461/929] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:01:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:00.540804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:00.573040 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:00.646838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564435e-4294-41a5-9d76-c173ae69dcd0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:00.683659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:00.684215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.684529 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.684809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.685513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:00.685809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:00.687183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fe1e-126e-466d-a4ee-7dc3b61b9153 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:00.692596 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 469/930] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:01:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:00.701635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:00.812906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a118fb-4f9f-468f-a0ba-9151a3396a20 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:00.827985 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:00.851356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:00.852380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.852889 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.853382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.854316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:00.855971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:00.876362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d232-695e-438b-9cf1-3edf414aca86 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.876927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d232-695e-438b-9cf1-3edf414aca86 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.876927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d232-695e-438b-9cf1-3edf414aca86 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.878258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 470/931] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:00.880323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 462/932] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:01:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:00.887417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:00.887417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:00.887417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:00.907907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:00.909341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:00.996069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 471/933] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:01.025519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.181536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a7ae-9e8c-448a-95c4-4537ea3346bf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.235642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.235642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.235642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.235642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.251345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1901317d-8c4c-4da5-8ffc-708e86eb0c56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:01.257148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:01.258287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:01.259235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.265298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 463/934] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:01.270960 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.293962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:01.348943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a4c-60f8-4206-8232-0dfb916963d9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.349232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a4c-60f8-4206-8232-0dfb916963d9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.349510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a4c-60f8-4206-8232-0dfb916963d9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.351117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 464/935] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:01.356581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.356873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.357153 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.380401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:01.381616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:01.423048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a157f00-41d8-47d4-83c4-571a9123ea11 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.425507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:01.501082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.501733 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.501972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.502250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.502988 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:01.503297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:01.505504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:01.506965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 465/936] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:01.530287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.531391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 472/937] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:01.539063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.649791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21d84c-c576-4e3b-a0ea-959c22120a12 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.683697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:01.694809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.695453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.695737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.696012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.696755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:01.698216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:01.701424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING keystone.server.flask.common [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 01:01:01.711217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59454a-9bfd-4ba6-9e85-e149114d9567 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.720205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.sql.core [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:01:01.720205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:01:01.720205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [parameters: {'id': '7f2681717d9b43eeb290afd3126373d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:01:01.720205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80327) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f2681717d9b43eeb290afd3126373d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f2681717d9b43eeb290afd3126373d2. Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:01:01.728217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 31 01:01:01.729266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application yield resource Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise self.value Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application session.commit() Jul 31 01:01:01.730327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:01:01.732019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:01:01.733073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:01:01.733953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [parameters: {'id': '7f2681717d9b43eeb290afd3126373d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.735021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:01.735919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f2681717d9b43eeb290afd3126373d2. Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 466/938] 10.222.0.40 () {60 vars in 1140 bytes} [Sun Jul 31 01:01:01 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:01.737001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.755970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:01.761853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.762871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.763459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.764064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.776527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:01.778756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:01.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:01.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:01.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:01.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:01.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:01.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:01.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 473/939] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:01.813917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.869506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999ed43-4297-4afc-b231-a678af6afffa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.917654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.918075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.918358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.918632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.925675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:01.927317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:01.927876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9a9a-724a-4d47-8f61-332376b2f8ac None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:01.939479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:01.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:01.941642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 467/940] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:01.947161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:01.966305 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:01.975711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:01.976417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:01.976700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:01.976999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:01.977752 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:01.978056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:01.979428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.000331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 474/941] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:02.005465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.056848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.096197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb158c-587b-4a9c-a41f-40a02a6b05ff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.133200 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.133838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.134121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.134394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.135182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:02.135292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374ee2-fab9-4383-962a-ee77e7c4d3df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.135524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.137489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9a67e-cc1e-46f7-9648-b531711b1ae7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.162699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 468/942] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:02.162699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee98a6-4f4d-4dbb-9bed-6dc4e7517a94 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.162699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee98a6-4f4d-4dbb-9bed-6dc4e7517a94 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.162699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee98a6-4f4d-4dbb-9bed-6dc4e7517a94 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.162699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 469/943] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:02.171018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.171549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.172040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.182109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.183037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.183321 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.183726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.193860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.195845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.202601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:02.204746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:02.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:02.212912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:02.214995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 475/944] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:02.222037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.308841 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 470/945] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:02.325685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.356844 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590abf69-112c-4375-8a98-08a9877d5f3f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.399167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.399795 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.400076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.400377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.401176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:02.401482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.401914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.403159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.422134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 476/946] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:02.427468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.448132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b466-5247-4408-8bdc-f94a26512977 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.486797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.487451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.487733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.488012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.488689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.490057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:02.499350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:02.500681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:02.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 471/947] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:02.508521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.556850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef7b6-1493-4f2c-b3f7-2b8e0a01e1bf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.598955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.599889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.600348 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.600770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.612723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.613406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d08999-0008-44a4-b922-412a20dd5fc6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.614646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:02.632311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:02.633472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:02.634575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:02.634575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:02.634575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:02.634575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:02.636677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 477/948] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:02.643799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.653165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.664199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.664877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.665235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.665589 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.666358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:02.666739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.668941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.679066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 472/949] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:02.680092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.767541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11c69-09fb-493d-b86f-0588e1130102 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.787097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6d376-3315-4459-9c04-26af34bc717a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.806798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.808028 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.809054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.809575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.810460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:02.810953 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.812761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.824210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.825193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.825560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.825955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.826651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:02.827029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.828515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:02.828969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 478/950] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:02.834303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.842213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 473/951] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:02.848432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:02.862687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.909407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:02.956544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a15c-a818-4fed-8b64-03e7a488b320 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.958280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd720cd-797f-499f-ad23-8adfda01b49d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:02.995212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:02.995981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:02.996941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:02.997316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:02.998120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:02.999584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.000424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.001348 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.001817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.002318 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.010509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4e86499c-7372-4686-a597-476dbefbaea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:03.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:03.033670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:03.036112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:03.037284 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 474/952] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:01:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:03.039264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 479/953] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:03.048410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:03.126556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475128d5-1523-42ad-b16f-c4cb362101b6 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.126759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475128d5-1523-42ad-b16f-c4cb362101b6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.127027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475128d5-1523-42ad-b16f-c4cb362101b6 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.132411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 480/954] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:03.136157 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.138574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.139245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.163767 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:03.165392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:03.195124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffcaf5-c8af-4f56-b2f6-813a2709544f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:03.209618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:03.236242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.237022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.237311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.237590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.238353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:03.238663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.240215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.256421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 475/955] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:03.257137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 481/956] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:03.261864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:03.283398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:03.297441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:03.371546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5f1d-2e55-4478-9ec6-3cc4e9adef39 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:03.410892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.411828 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.412224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.412633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/1b4dc0771b604dfbb30663d5374bcf69/roles/4614644ededa4bab99725c11d75162ff` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.415009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=1b4dc0771b604dfbb30663d5374bcf69, role_id=4614644ededa4bab99725c11d75162ff)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.416597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.425365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcba83-a909-4057-9aad-800acb17f5a6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:03.434770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 476/957] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:01:03 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/1b4dc0771b604dfbb30663d5374bcf69/roles/4614644ededa4bab99725c11d75162ff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:01:03.475031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.475996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.476464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.476917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.477708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.479345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:03.490947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:03.492433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:03.493557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:03.496997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 482/958] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:03.503737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:03.543674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:03.625671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09a20e-9fb3-4f66-bdee-06347c703cf5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:03.663970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.664569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.664856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.665133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.665817 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:03.666124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.667487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76ea71-7ec1-4d82-bae7-6fb84ffbde9f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.676952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 477/959] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:03.685589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:03.768724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:03.796784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bbcce-8ce2-40ce-b100-528d897fe532 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:03.834233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:03.835199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:03.835492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:03.835772 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:03.836491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:03.836801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:03.838175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defe85-49d1-4be8-909d-6f1a5a3e73b6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:03.843478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 483/960] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:04.348333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94bfb-cb8e-4420-9547-a5eac4f270a8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:04.349000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94bfb-cb8e-4420-9547-a5eac4f270a8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:04.349000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94bfb-cb8e-4420-9547-a5eac4f270a8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:04.350538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 478/961] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:04.356580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:04.357389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:04.357924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:04.376816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:04.378406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:04.453894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 484/962] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:04.478020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94bfb-cb8e-4420-9547-a5eac4f270a8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:04.581318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:04.592964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94bfb-cb8e-4420-9547-a5eac4f270a8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:04.628708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:04.629342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:04.629629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:04.629905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:04.630588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:04.632047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:04.649168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.sql.core [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:01:04.649168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:01:04.649168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [parameters: {'user_id': 'bbb34a196e6d4549b1c7220d75c1b6ee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:01:04.649168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80327) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:01:04.657110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:01:04.657975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application yield resource Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise self.value Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application session.commit() Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:01:04.659075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:01:04.659982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:01:04.660921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:01:04.661759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bbb34a196e6d4549b1c7220d75c1b6ee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:04.662677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 31 01:01:04.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:04.670207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 479/963] 10.222.0.40 () {60 vars in 1131 bytes} [Sun Jul 31 01:01:04 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:04.671070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:04.750120 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:04.788088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eac8a0-5670-4295-af09-c1fb02ac6f10 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:04.824993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:04.825651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:04.825933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:04.826214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:04.833961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:04.835470 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4c5fd5c9-1af3-44ee-804c-73b9d7085213 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:04.849307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:04.851307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:04.852880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 485/964] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:04.857035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:04.971788 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb1dd-4672-459c-a4be-40f8f6730072 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.010831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:05.012046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.012580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.013066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.014067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:05.014604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:05.016506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f37560-6a4c-478f-b560-8c0ef00db5c4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:05.062393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 480/965] 10.222.0.40 () {56 vars in 1101 bytes} [Sun Jul 31 01:01:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:05.229336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f045-dbec-4f2a-aa2c-049f0c14d3ee None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.229684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f045-dbec-4f2a-aa2c-049f0c14d3ee None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.229911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f045-dbec-4f2a-aa2c-049f0c14d3ee None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.231881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 486/966] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:05.237635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.237919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.238199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.258325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:05.259840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:05.269098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:05.333267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 481/967] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:05.355088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f045-dbec-4f2a-aa2c-049f0c14d3ee None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:05.457142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f045-dbec-4f2a-aa2c-049f0c14d3ee None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.483370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:05.492069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:05.492743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.493023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.493294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.493915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:05.495272 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ec2050c4-d329-44ad-ac46-8bd39cc1b107 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:05.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:05.505756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:05.506652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 487/968] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:05.514358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:05.623167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afd18-e98e-4df9-be9d-d07c28bbfc16 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.660171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:05.660843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.661130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.661409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.662096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:05.662195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d747-28bd-400f-9de7-083a2ebab9c7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.662404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:05.662511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d747-28bd-400f-9de7-083a2ebab9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.663254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d747-28bd-400f-9de7-083a2ebab9c7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.663786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:05.664788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 488/969] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:05.669024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 482/970] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:05.670201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.670580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.670930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.674808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:05.686271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:05.690301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:05.691503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:05.769201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 489/971] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:05.788487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2350-325a-4fea-b754-485567362ae1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.791711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:05.826759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:05.827392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.827674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.827951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.828671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:05.828979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:05.830330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:05.836329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 483/972] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:05.842465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:05.895479 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cc010-4e97-4ae7-ac0d-b1ff3e8eb042 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.923842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:05.924085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:05.942019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:05.942952 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.943359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.943764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.956721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c583-25d2-4bd9-a97e-c6d5b8e9c98f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:05.958149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ff296147-9307-45ce-a6b4-fd6cee16125a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:05.963778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:05.965145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 490/973] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:05.972128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a5d3-91b7-47d1-ab4a-4520f91f1891 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:05.973924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a5d3-91b7-47d1-ab4a-4520f91f1891 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:05.973924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a5d3-91b7-47d1-ab4a-4520f91f1891 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:05.973924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 491/974] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:05.973924 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138a5d3-91b7-47d1-ab4a-4520f91f1891 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.008894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.009829 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.010230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.010641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.011854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] RBAC: Adding query filter params (interface=admin, service_id=5d88c629f57d463da22351e21ca6feb2, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:06.012357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.014472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241eaf1-3f47-4af1-899e-ee3dcba51100 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.028356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 484/975] 10.222.0.40 () {56 vars in 1249 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/endpoints?service_id=5d88c629f57d463da22351e21ca6feb2&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:06.028356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20b44-df71-411f-837f-084ec37a631b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.028356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20b44-df71-411f-837f-084ec37a631b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.028356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20b44-df71-411f-837f-084ec37a631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.046238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bad20b44-df71-411f-837f-084ec37a631b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:06.047426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bad20b44-df71-411f-837f-084ec37a631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:06.079430 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138a5d3-91b7-47d1-ab4a-4520f91f1891 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.113677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.114303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.114584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.114861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.115580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:06.115868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 485/976] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:06.115963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.116740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20b44-df71-411f-837f-084ec37a631b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.117375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.134993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 492/977] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:06.135855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.183963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:06.185923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:06.224547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20b44-df71-411f-837f-084ec37a631b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.238564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2404d3-816b-45d2-a1ab-a684bcd6391e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.257936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.258572 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.258861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.259141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.259798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.261189 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.267593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 486/978] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:01:06.268386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.275065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.275738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.276387 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.288938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.291151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:06.315838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:06.316916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:06.317813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:06.317813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:06.317813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:06.317813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:06.318540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 493/979] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:06.324966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.389983 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8cec-e686-4b31-a3c2-98e5715e61e1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.418525 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:06.428703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.429344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.429623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.430443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.430631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.431951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.437147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:06.445161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568cc33-bbd3-4c2e-b126-9aabac32b6a5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.452164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 487/980] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:06 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:06.493416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.494126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.494335 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.494594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.495291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:06.495660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.497110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.515971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 494/981] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:06.519552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.636011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd471-9ce7-4c86-b730-4ba0ae2c5f37 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.672389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.673059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.673345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.673625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.681598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.683301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:06.695149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:06.696096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:06.697099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 488/982] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:06.702936 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.807645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44b48-aaf9-40d4-9492-f904a2caf526 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:06.843360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:06.843994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:06.844306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:06.844591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:06.845396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:06.845705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:06.847138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:06.864686 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 495/983] 10.222.0.40 () {56 vars in 1149 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:06.870079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:06.926022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:06.982895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0cd1-d02d-442d-972a-c45cdf0faa8c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.018336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:07.018969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:07.019256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:07.019536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:07.086783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:07.088243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:07.142074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:07.195826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 489/984] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:06 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:07.201343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:07.213492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:07.303238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbd35e-4b46-4406-b2eb-eb8138e94dce None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.336580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:07.337229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:07.337513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:07.337792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:07.348667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:07.350140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:07.366065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:07.367021 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:07.367896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:07.367896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:07.367896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:07.367896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:07.371688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 496/985] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:07.372960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:07.472774 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83223bff-9424-4d78-b24a-96fe8f838ecd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.506828 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:07.507450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:07.507733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:07.508018 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:07.508725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:07.509031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:07.510386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:07.521769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 490/986] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:07.527160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:07.592629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:07.637212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2dd4-0203-4e8f-8f0d-f64afa3eb818 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.672337 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:07.673296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:07.673575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:07.673846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:07.680894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:07.682585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:07.694153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:07.695029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:07.701327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 497/987] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:07.701982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:07.713428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:07.804695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f255-6b6c-41cc-a888-bcab179bd5d6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.840489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:07.841491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:07.841973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:07.842445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:07.843465 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:07.843971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:07.845612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81ee4c-2db5-4cf8-8440-ff0c38b59063 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:07.858312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 491/988] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:07.864037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:07.972079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db878-6e83-4459-9ee7-8b2908e3713f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:07.995899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:08.009392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.010094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.010384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.010661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.011489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] RBAC: Adding query filter params (role.id=4614644ededa4bab99725c11d75162ff, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=1b4dc0771b604dfbb30663d5374bcf69) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:08.011802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.013257 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998b2fb-a5fe-4a55-b305-9b18679d30fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.028288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 498/989] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:07 2022] GET /identity/v3/role_assignments?user.id=1b4dc0771b604dfbb30663d5374bcf69&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=4614644ededa4bab99725c11d75162ff => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:08.323058 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552873-8c3d-411b-9614-ee3abb7c3759 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.323385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552873-8c3d-411b-9614-ee3abb7c3759 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.323631 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552873-8c3d-411b-9614-ee3abb7c3759 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 492/990] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:08.330133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f07b7-d56a-41a5-bdcf-e550c686b501 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.330428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f07b7-d56a-41a5-bdcf-e550c686b501 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.330718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f07b7-d56a-41a5-bdcf-e550c686b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.348682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a96f07b7-d56a-41a5-bdcf-e550c686b501 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:08.349874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a96f07b7-d56a-41a5-bdcf-e550c686b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:08.421632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 499/991] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:08.444102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22552873-8c3d-411b-9614-ee3abb7c3759 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.515558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:08.523395 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ff1a-9465-4403-9850-9d49b05e3b8b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.523714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ff1a-9465-4403-9850-9d49b05e3b8b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.523958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ff1a-9465-4403-9850-9d49b05e3b8b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.526136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 500/992] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:08.530371 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.530939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.530939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.550865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:08.551382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22552873-8c3d-411b-9614-ee3abb7c3759 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:08.552072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:08.587670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.588385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.588677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.588951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.589708 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.591173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:08.600732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:08.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:08.602599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 493/993] 10.222.0.40 () {56 vars in 1126 bytes} [Sun Jul 31 01:01:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:08.608043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.634001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 501/994] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:08.656806 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.714663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:08.718829 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334afea6-9c8a-42c9-aa9f-dd6cd8247c33 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:08.751187 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:08.756660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.757300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.757587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.757867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.758554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:08.758867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.760237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.765907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 494/995] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:08.771270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.779672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92eaac-a391-4d84-934e-b045b8b3f2ef None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:08.815982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.816667 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.816953 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.817239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.817874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.819248 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:08.828521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:08.829490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:08.830370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 502/996] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:08.835447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.881318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7812bed-6538-45b2-80f1-48f21a7d5092 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:08.918252 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.918880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.919159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.919432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.920104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:08.920438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.921899 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.926732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 495/997] 10.222.0.40 () {56 vars in 1122 bytes} [Sun Jul 31 01:01:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:08.932235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:08.952238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455025c-1f3d-4c82-a78a-ca8aedceec5a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:08.962956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:08.988499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:08.989057 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:08.989341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:08.989620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:08.990347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:08.990659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:08.992032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:08.995392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:09.001689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 503/998] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:09.002744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:09.047757 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ece1e-928c-4342-930b-3cb6e260d8aa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:09.084494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:09.085474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:09.085994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:09.086508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:09.087404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:09.088988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:09.108969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 496/999] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:01:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:09.121911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a6aae-ddd7-458a-affb-3bb2adbb7b5b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:09.174261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:09.174977 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:09.175204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:09.175554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:09.176303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:09.176676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:09.178150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:09.185947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 504/1000] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:09.190740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:09.303056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b733e-de23-4b75-b054-08f8985dd39d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:09.322791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:09.337394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:09.338017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:09.338297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:09.338571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:09.339318 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] RBAC: Adding query filter params (interface=public, service_id=6a21fe41035845e1a5f82e0d58900841, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:09.340155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:09.341546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9a18b-b43c-4058-a7db-6d68355fccf3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:09.346451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 497/1001] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:01:09 2022] GET /identity/v3/endpoints?service_id=6a21fe41035845e1a5f82e0d58900841&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:09.352016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:09.386845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:09.454962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaba712-fd29-4f24-9985-304972cb0c42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:09.491033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:09.491657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:09.491936 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:09.492209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:09.492920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:09.494283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882dcfc-69b5-40a1-aba5-8f5177295777 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:09.500672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 505/1002] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:01:09 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:01:10.086126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba164-2cb3-4be4-afc3-dfee513a33cc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:10.086658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba164-2cb3-4be4-afc3-dfee513a33cc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:10.086738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba164-2cb3-4be4-afc3-dfee513a33cc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:10.088196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 498/1003] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:10.093230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:10.093632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:10.093792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:10.112513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:10.114099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:10.190187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 506/1004] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:10.212336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ba164-2cb3-4be4-afc3-dfee513a33cc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:10.319680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ba164-2cb3-4be4-afc3-dfee513a33cc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:10.354275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:10.354849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:10.355696 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:10.355989 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:10.356675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:10.358030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:10.369101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:10.370154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:10.371640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:10.378873 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 499/1005] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Jul 31 01:01:10 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:10.379002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:10.404407 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:10.476879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b591-ac3a-40f6-a649-11c43ccc8633 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:10.511286 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:10.512002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:10.512312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:10.512592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:10.513275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:10.513585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:10.514954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42887d4-6a49-4b1e-bb46-89201d348bc9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:10.519955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 507/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:10.525461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:10.576533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:10.632089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d79c3-24a3-43cd-bd5c-3703386e3c16 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:10.666693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:10.667330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:10.667636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:10.667911 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:10.669054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:10.669496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:10.670900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6adf8-996d-49c4-8cf5-e3db1c6b053c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:10.676174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 500/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:11.178317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516fe6-cf75-481f-bfed-779be0ca24be None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.178855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516fe6-cf75-481f-bfed-779be0ca24be None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.178855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516fe6-cf75-481f-bfed-779be0ca24be None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.180394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 508/1008] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:11.185740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.186206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.186444 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.204782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:11.205988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:11.275361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 501/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:11.298448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78516fe6-cf75-481f-bfed-779be0ca24be None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:11.397945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:11.409050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78516fe6-cf75-481f-bfed-779be0ca24be None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:11.444576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:11.445230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.445514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.445789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.446946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:11.448428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d72e4-ba14-460c-9da4-97d073ed08af None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:11.450215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 509/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:11.455842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:11.499069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0633b-d7b5-4af5-8be1-e79bfb98be8c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.499410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0633b-d7b5-4af5-8be1-e79bfb98be8c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.500197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0633b-d7b5-4af5-8be1-e79bfb98be8c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.500328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:11.501229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 510/1011] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:11.506829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.507108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.507388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.525471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:11.526657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:11.560353 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33010cf2-00d1-4fb0-8979-02b0ae16f136 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:11.594463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:11.595085 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.595425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.595644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.596424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:11.600278 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 511/1012] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:11.600420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:11.621242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:11.627483 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 502/1013] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:11 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:11.723856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:11.736466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418af-88c6-4373-b180-a6e003dfdc7c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:11.773996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:11.774710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.774993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.775267 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.775904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:11.777853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:11.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:11.789228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:11.790082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 512/1014] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:11.795866 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:11.895580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:11.904723 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf65c1-d62e-46ed-9e51-77d61b2e4266 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:11.939574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:11.940209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:11.940527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:11.940806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:11.941489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:11.941797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:11.943196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:11.953199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 503/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:11.954966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:12.059315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f38-81bd-4e68-82f6-60f16bb111f1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:12.094089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:12.094785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:12.095065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:12.095339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:12.096013 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:12.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:12.097710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e0e8-846c-4b31-86bb-20cacfc56220 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:12.102837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 513/1016] 10.222.0.40 () {56 vars in 1112 bytes} [Sun Jul 31 01:01:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:12.108536 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:12.217502 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33973935-85a7-4ed5-a308-1b4acd641267 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:12.252692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:12.253316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:12.253594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:12.253864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:12.254581 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:12.255942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2833-0e5d-452b-8067-02e5b8ac1c72 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:12.277334 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 504/1017] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:01:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:12.732145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11ffd-f665-4c3a-aec8-8cd1446d2ebf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:12.732699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11ffd-f665-4c3a-aec8-8cd1446d2ebf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:12.732809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf11ffd-f665-4c3a-aec8-8cd1446d2ebf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:12.734133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 514/1018] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:12.739364 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b027f-72c9-43a1-954c-8767a903a79e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:12.739659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b027f-72c9-43a1-954c-8767a903a79e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:12.740017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b027f-72c9-43a1-954c-8767a903a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:12.759580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f47b027f-72c9-43a1-954c-8767a903a79e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:12.760803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f47b027f-72c9-43a1-954c-8767a903a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:12.776173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:12.848322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 505/1019] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:12.870503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf11ffd-f665-4c3a-aec8-8cd1446d2ebf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:12.893193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:12.982093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf11ffd-f665-4c3a-aec8-8cd1446d2ebf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:13.016655 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:13.017199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:13.017483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:13.017758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:13.018460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:13.019834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b384b1-e836-4b3e-b61a-5d0a2475d58f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:13.038412 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 515/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:12 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:13.780635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0782-6d7e-4f04-84ef-28c032efac4d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:13.781238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0782-6d7e-4f04-84ef-28c032efac4d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:13.781238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0782-6d7e-4f04-84ef-28c032efac4d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:13.782681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 506/1021] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:13.787619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:13.788014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:13.788217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:13.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:13.807762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:13.882969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 516/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:13.907262 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0782-6d7e-4f04-84ef-28c032efac4d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:14.010512 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0782-6d7e-4f04-84ef-28c032efac4d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:14.047551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:14.048116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.048427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.048803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.049844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:14.051271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03a33-d089-41d6-977a-603407e65d8c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:14.057880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 507/1023] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:14.059233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:14.062424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:14.172399 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19703ce-6a05-4129-8269-16df6c846031 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:14.208699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:14.209331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.209616 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.209895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.210594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:14.212036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c848fc-2a49-41d3-aa07-4dcb1bfd5337 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:14.239525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 517/1024] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:01:14 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:01:14.407582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec9e4-7307-414b-9378-20c662a6555a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.407881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec9e4-7307-414b-9378-20c662a6555a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.408076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec9e4-7307-414b-9378-20c662a6555a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.409712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 508/1025] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:14.415870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.416234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.416568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.435383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:14.436719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:14.494683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:14.513302 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 518/1026] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:14.536547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec9e4-7307-414b-9378-20c662a6555a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:14.549174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:14.646951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec9e4-7307-414b-9378-20c662a6555a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:14.681815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:14.682741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.683027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.683824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.694475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:14.700065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:14.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:14.702052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:14.704319 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 509/1027] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:01:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:14.707658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:14.817518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b25b7d-35ba-47dd-a416-a791c384cad2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:14.853730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:14.853730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:14.853730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:14.853730 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:14.854469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:14.854776 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:14.857455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:14.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 519/1028] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:14.874478 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:14.947441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:14.983578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7373f-9341-43da-b140-0bd206269a6a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.018329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.019063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.019271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.019549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.029843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.031293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f914a400-c373-409d-9b11-425aa5ed0726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:15.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:15.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:15.048961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:15.048961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:15.048961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:15.048961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:15.053567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 510/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:15.054576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.084635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feff4d-13ec-42eb-9e04-eb551663e8b5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.084926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feff4d-13ec-42eb-9e04-eb551663e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.085208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feff4d-13ec-42eb-9e04-eb551663e8b5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.086656 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 511/1030] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:15.091721 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.092009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.092305 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.111492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:15.112856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:15.119410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.176573 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf420-71b4-4605-8a56-3c2b2068df2b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.200798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 512/1031] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:15.214627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.215257 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.215539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.215875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.216605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:15.216912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.218283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.220295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.231223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 520/1032] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:15.236681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.276476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.333136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142425-dc4d-4b2f-b438-5ed8f6d21b0a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.343615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c635-1133-4d6f-b253-e46e91ec5a9b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.357668 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.371807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.372495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.372789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.373057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.373695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.375059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.381495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.382137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.382419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.382691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:15.384616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:15.385846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:15.387625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 513/1033] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:15.392240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.396220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.397700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:15.409809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:15.410814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:15.412100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 521/1034] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:15.416533 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.510023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9e4c-6180-4067-bd19-20b68c1487a6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.526565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.531753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc4ede-a809-480b-afd9-36c059f66afe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.550110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.550742 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.551027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.551427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.552113 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] RBAC: Adding query filter params (name=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:15.552450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.553824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.561343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 514/1035] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:15.566459 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.572486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.573121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.573408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.573687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.575055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:15.575366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.576848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.595497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 522/1036] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:15.601327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.634163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.683117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07924a-2c53-4e2f-8736-b1bc00b33160 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.710416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ae6b7-3a4b-42f5-9c6a-6db9d5f7e42f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.721168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.722117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.722407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.722990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.723688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:15.723979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.725374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.730565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 515/1037] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:15.736099 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.748948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.749577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.749910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.750189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.781207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.819958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.821452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.840979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09a7fb-63e1-420b-982a-6efb481522a6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:15.851274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:15.877789 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:15.878422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:15.878704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:15.878970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:15.879824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] RBAC: Adding query filter params (interface=public, service_id=06233043c8d44cf69180ff550f140fad, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:15.880035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:15.881421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:15.887821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 516/1038] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/endpoints?service_id=06233043c8d44cf69180ff550f140fad&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:15.894669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:15.934829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 523/1039] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:15.940403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.004551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f737b6a-8f97-4499-ada9-2dd0a699b5da None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.012878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.043273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.043877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.044104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.044428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.045087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.046449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.048798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cda7e-8c2e-4644-b6d6-059440f6c119 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.053315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 517/1040] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:01:16.094898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.101784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.102463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.102749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.103029 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.115833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.117384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:16.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:16.141722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:16.143166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:16.143166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:16.143166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:16.143166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:16.143166 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 524/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:16.145001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.259647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922059-f730-41f8-9620-8a62ca0a7bc2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.295005 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.295551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.295838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.296116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.296891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:16.297197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.298616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edeeb-ba25-466f-b12b-327241100305 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.312292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 518/1042] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:16.317669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.346840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b411-3b89-4a25-a4bf-baf764776a0a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.347158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b411-3b89-4a25-a4bf-baf764776a0a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.347628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b411-3b89-4a25-a4bf-baf764776a0a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.349177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 519/1043] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:16.355559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.355967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.356164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.374662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:16.375883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:16.400692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.441090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49dd07-900b-4d85-8422-48d045eac665 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.450009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 520/1044] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:16.473372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.477008 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.477008 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.477214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.477472 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.486569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:16.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:16.499401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:16.500341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 525/1045] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:16.505308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.557215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.594580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fee70-f566-42d2-9f4f-adbd938e42fd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.628219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2db1-536d-4790-bc35-47b46e426d0d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.630628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.631362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.631649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.631922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.642351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:16.647306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:16.648242 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:16.654139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 521/1046] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:16.657604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.672534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.673171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.673460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.674071 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.674556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:16.674875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.676347 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.680863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.695781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 526/1047] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:16.696956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.771418 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ba497-043a-4ad7-8445-93e1de4958d1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.805770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa79123-b484-4ce8-8390-72982325c319 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:16.807813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.816479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.817141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.817425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.817720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.818482 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:16.818796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.820180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.830062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 522/1048] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:16.835485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:16.845060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:16.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:16.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:16.846277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:16.847032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] RBAC: Adding query filter params (role.id=4614644ededa4bab99725c11d75162ff, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:16.847344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:16.848842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:16.855600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 527/1049] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=4614644ededa4bab99725c11d75162ff => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:16.939710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:16.961182 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66509520-4ec9-43bb-bb5d-6c31e35a0eac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:17.000377 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:17.001045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:17.001329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:17.001607 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] PATH_INFO: `/v3/users/cc66329e22de46d599462b5ca768171f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:17.019453 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] RBAC: Authorizing `identity:get_user(user_id=cc66329e22de46d599462b5ca768171f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:17.020323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:17.022396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 523/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:16 2022] GET /identity/v3/users/cc66329e22de46d599462b5ca768171f => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:17.028370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:17.141390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80421-c13f-411e-8b13-e91a9840f12c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:17.180877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:17.181530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:17.181817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:17.182096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:17.223458 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:17.260946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:17.262954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:17.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 528/1051] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:01:17.371122 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:17.471758 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8e26-3d43-4f5f-a351-f167d1b8782c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:17.507005 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:17.507669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:17.507953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:17.508228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:17.509423 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:17.510882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6317-9b72-42b0-acfb-d4ac6927fb89 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:17.512880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 524/1052] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:17 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:17.518762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:17.592144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:17.630352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816ed9-3da0-4f6c-b6af-76f66279f1ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:17.665658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:17.666292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:17.666577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:17.666853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:17.667714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=4a5f475d16704afab2dc8349bebe1cd8, user.id=cc66329e22de46d599462b5ca768171f) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:17.668026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:17.669518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68774-51f8-4ad2-aece-4c3a15d36470 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:17.675497 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 529/1053] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:17 2022] GET /identity/v3/role_assignments?user.id=cc66329e22de46d599462b5ca768171f&scope.project.id=4a5f475d16704afab2dc8349bebe1cd8&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:18.116451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2811b-6efa-4288-8dc5-a93fe6d2072a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.116965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2811b-6efa-4288-8dc5-a93fe6d2072a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.117068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2811b-6efa-4288-8dc5-a93fe6d2072a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.118351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 525/1054] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:18.124518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147c26-1d28-436d-befc-086e07d2758b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.125006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147c26-1d28-436d-befc-086e07d2758b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.125088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147c26-1d28-436d-befc-086e07d2758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.145381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-41147c26-1d28-436d-befc-086e07d2758b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:18.146593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-41147c26-1d28-436d-befc-086e07d2758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:18.222241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 530/1055] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:18.246638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2811b-6efa-4288-8dc5-a93fe6d2072a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:18.258584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:18.371880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2811b-6efa-4288-8dc5-a93fe6d2072a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:18.407755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:18.408445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.408735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.409013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.409690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:18.411031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:18.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:18.421544 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:01:18.422413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:18.424588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 526/1056] 10.222.0.40 () {56 vars in 1105 bytes} [Sun Jul 31 01:01:18 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:18.427794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147c26-1d28-436d-befc-086e07d2758b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:18.491229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:18.534820 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147c26-1d28-436d-befc-086e07d2758b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:18.570117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:18.570758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.571047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.571325 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.572017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] RBAC: Adding query filter params (name=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:18.572348 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:18.573799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:18.579280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 531/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:18.584945 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:18.658663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:18.693613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6fd8-30f8-48df-9029-ff8605c08da5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:18.729208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:18.729868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.730157 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.730438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.731121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:18.731429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:18.732837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101a0e-21ec-4e87-9796-5fd8d007516f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:18.738114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 527/1058] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:18.744498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:18.856944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47414b-45d8-426b-9d29-7b4a9d97f48a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:18.881934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:18.891984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74eb99-c8f8-420f-af66-d24c7ec15141 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.892634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74eb99-c8f8-420f-af66-d24c7ec15141 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.892634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74eb99-c8f8-420f-af66-d24c7ec15141 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.893962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 528/1059] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:18.899272 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.899565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.899849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.902317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:18.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:18.903562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:18.904036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:18.904938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:18.906462 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:18.918966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:18.920458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:18.936286 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 532/1060] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:01:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:19.007381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 529/1061] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:19.030317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.146385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c57-0be1-4e26-b730-5fe65a6540bd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.185745 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:19.186796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.187351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.187863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.199525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:19.205396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:19.206418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:19.207319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:19.209748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 533/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:19.216027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.290203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:19.331661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa8dc7-0f79-4a77-aab4-39e4aca2a4be None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.365634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:19.366261 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.366541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.366814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.367527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:19.367832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:19.369239 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:19.384022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 530/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:19.386027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.435131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:19.505036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5331f1-848b-47d0-995a-144fe4bad070 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.538357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:19.539004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.539282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.539558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.550633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:19.552068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c23fd9c1-db21-4c30-a9da-769411c30e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:19.566966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:19.567870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:19.568807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:19.568807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:19.568807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:19.568807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:19.572326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 534/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:19.574191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.677690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b412c9-cf9d-4691-bb6b-c3a31393f3e9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.702028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:19.713620 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:19.714802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.715086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.715359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.716051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:19.716492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:19.717740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:19.727727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9593d-cc76-4e1c-a26b-a0cdc9a90c5e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.728097 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9593d-cc76-4e1c-a26b-a0cdc9a90c5e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.728474 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9593d-cc76-4e1c-a26b-a0cdc9a90c5e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.729901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 535/1065] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:19.734875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.735414 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.735876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.737847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 531/1066] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:19.739068 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.755145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:19.756316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:19.827174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 536/1067] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:19.843998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd92e5-9d0e-4505-88fe-d2061a10d361 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.853196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.874099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:19.882135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:19.882783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:19.883168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:19.883333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:19.891644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:19.893670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:19.908322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:19.909323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:19.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 532/1068] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:19.916038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:19.963301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd257d-14ce-4a10-b602-f9799c635ee5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:19.965264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.005962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.007034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.007324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.008004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.020955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:20.028565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:20.029512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:20.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 537/1069] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:20.034281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdca6ef-c647-4691-9cdb-3fc33fb65689 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.035663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.073611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.073611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.074050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.074050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.075704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:20.075704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.076579 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.096639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 533/1070] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:01:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.102469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.139481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.161822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e6f7-483e-479a-8f1f-887d77e5343d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.201032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.201652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.201933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.202206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.202915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:20.203216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.204605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.212754 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 538/1071] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.213114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066200b6-cb3c-4849-97d2-07c0ab6923a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.215048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.218609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.252819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.254095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.254588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.255051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.266031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.267402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:20.283306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:20.284289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:20.285212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:20.285212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:20.285212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:20.285212 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:20.286812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 534/1072] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:20.292781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.334576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6ba6b-abff-469d-aea4-58dab3c122d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.384353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.385016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.385301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.385578 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] PATH_INFO: `/v3/users/cc66329e22de46d599462b5ca768171f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.386803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] RBAC: Authorizing `identity:get_user(user_id=cc66329e22de46d599462b5ca768171f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.388275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.389896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 539/1073] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/users/cc66329e22de46d599462b5ca768171f => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.395489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.411226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.421179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bb05-6bee-4584-8eb3-2b8e8c43c533 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.458407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.459043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.459327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.459603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.460324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:20.460638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.462012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.479879 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 535/1074] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.481199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.497613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.505246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b119f7-9f97-4790-973d-1737462ab472 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.542307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.543009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.543296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.543576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.544775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.546221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.548054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 540/1075] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.553896 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.591549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e5e5f-6575-471a-88aa-574924ef8b7f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.627958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.628744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.629030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.629308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.636686 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.638125 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.640190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:20.650322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:20.651258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:20.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 536/1076] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:20.657865 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.666535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75678fb-3a85-4aa8-846a-3df3404a6d02 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.705291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.705980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.706266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8/users/cc66329e22de46d599462b5ca768171f/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.708550 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5f475d16704afab2dc8349bebe1cd8, user_id=cc66329e22de46d599462b5ca768171f, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.710291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.728817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 541/1077] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:01:20 2022] PUT /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8/users/cc66329e22de46d599462b5ca768171f/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:01:20.749126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:20.778841 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ace6-2f7f-4d4c-aee0-97aa5dfd7f99 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.818267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.818855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.819143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.819420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.820196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:20.820539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.822001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60120861-99d8-4852-bad0-d92526ba0519 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:20.841365 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 537/1078] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:20.842649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:20.956932 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3224e-2ddb-4746-977b-e53bd59e2fe6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:20.991540 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:20.992225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:20.992558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:20.992812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/4614644ededa4bab99725c11d75162ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:20.995004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=d7b7ff8e53f84c30a43f0f8218ef6d30, role_id=4614644ededa4bab99725c11d75162ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:20.996995 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af502d6f-5c21-44d6-a652-a26fd50d00c0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:21.006175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:21.013736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 542/1079] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:01:20 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/d7b7ff8e53f84c30a43f0f8218ef6d30/roles/4614644ededa4bab99725c11d75162ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:01:21.039172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f8a8-3b6d-40fc-bc6e-7b45f1e7081e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:21.039670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f8a8-3b6d-40fc-bc6e-7b45f1e7081e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:21.040140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37f8a8-3b6d-40fc-bc6e-7b45f1e7081e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:21.042171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 538/1080] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:21.048495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:21.048894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:21.049084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:21.069293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:21.070440 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:21.156709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 543/1081] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:21.179161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37f8a8-3b6d-40fc-bc6e-7b45f1e7081e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:21.287120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37f8a8-3b6d-40fc-bc6e-7b45f1e7081e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:21.321852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:21.322418 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:21.322703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:21.322978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:21.326203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:21.394441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:21.395885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:21.500425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 539/1082] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:21.501982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:21.604072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b641a3-6404-404b-92e1-8cf24b79cf41 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:21.632927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:21.640948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:21.641611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:21.641902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:21.642179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:21.653382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:21.654923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e4c922d7-5244-4ca2-86bd-d2fc3b089778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:21.669978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:21.670872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:21.671846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:21.671846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:21.671846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:21.671846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:21.676140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 544/1083] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:21.677386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:21.713325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:21.803064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4204-b294-4406-9d6a-514646c836aa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:21.838507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:21.839204 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:21.839991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:21.840275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:21.840991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:21.841295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:21.842666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba1f9-ce2b-4f9e-be6b-1b2d5cf735bf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:21.864386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 540/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:22.753614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0c2c-b453-45a2-86db-7bbdde01bd95 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:22.754149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0c2c-b453-45a2-86db-7bbdde01bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:22.754149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0c2c-b453-45a2-86db-7bbdde01bd95 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:22.755512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 545/1085] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:22.760781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d874bb-1638-4c1e-80c8-5796a8463502 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:22.761264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d874bb-1638-4c1e-80c8-5796a8463502 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:22.761358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d874bb-1638-4c1e-80c8-5796a8463502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:22.779653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c6d874bb-1638-4c1e-80c8-5796a8463502 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:22.780871 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c6d874bb-1638-4c1e-80c8-5796a8463502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:22.846400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 541/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:22.869883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0c2c-b453-45a2-86db-7bbdde01bd95 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:22.975212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0c2c-b453-45a2-86db-7bbdde01bd95 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.009168 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.009745 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.010023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.010297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.020357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:23.025279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:23.026228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:23.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 546/1087] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:23.032946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.033238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd083143-7e58-4c5f-8140-27e728eacad5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.033534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd083143-7e58-4c5f-8140-27e728eacad5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.033818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd083143-7e58-4c5f-8140-27e728eacad5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.035177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 542/1088] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:23.040143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.040456 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.040739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.059210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:23.060472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:23.077037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.077937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.130140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 543/1089] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:01:23.137159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a150ff-a61b-4490-bb77-326ba49081e8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.154087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.171467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.172130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.172442 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.172728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.173444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:23.173749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.175111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.183898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 547/1090] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:23.189603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.252424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f6443-8324-422a-a6c8-a71d560a0e48 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.286315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.286888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.287174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.287457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.289522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81129-2e4f-4c1d-854d-b5e8dbd9bdda None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.292639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.298027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:23.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:23.303895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:23.304785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 544/1091] 10.222.0.40 () {56 vars in 1120 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:23.310463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.324368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.325015 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.325304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.325581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] PATH_INFO: `/v3/users/cc66329e22de46d599462b5ca768171f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.326576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.326749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] RBAC: Authorizing `identity:get_user(user_id=cc66329e22de46d599462b5ca768171f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.328338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.330108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 548/1092] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/users/cc66329e22de46d599462b5ca768171f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:23.335775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.409772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9097-3e00-45df-bba5-155bc5e55c23 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.436599 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d46b1-1869-41d4-9db5-a58ebf748d0d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.442772 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.443389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.443670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.443949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.444679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:23.444982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.446333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.454619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 545/1093] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:23.460341 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.472382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.473020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.473339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.473681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.516296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.536858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.544449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.545919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.562141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197327-5d36-4fea-8a2a-f4d59a6cfb01 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.610826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.611450 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.611741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.612023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.623590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.625140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:23.639750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:23.641028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:23.642036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:23.642036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:23.642036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:23.642036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:23.642036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 546/1094] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:23.646647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.667090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 549/1095] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:01:23.668756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.737728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.752393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f36de-415e-4103-9da5-16a9912dc85c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.767111 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9263f2-c529-45d7-9e48-aac1c426f3be None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.778223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:23.786738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.787421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.787659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.787947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.788675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:23.788980 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.790347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.802083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.802632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 547/1096] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:23.802758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.802996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.803274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.804470 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.805914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.807880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 550/1097] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:23.808885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.813619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.913164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de670f-ebac-4bce-9cd9-80ca68c9b88f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.917295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177494-5650-4bb0-bea6-d2741d74a1e1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:23.950229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.950850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.951132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.951408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.951511 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:23.952098 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:23.952219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=4a5f475d16704afab2dc8349bebe1cd8, user.id=cc66329e22de46d599462b5ca768171f) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:23.952413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:23.952544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.952682 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:23.953949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.959857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:23.960014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 551/1098] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/role_assignments?user.id=cc66329e22de46d599462b5ca768171f&scope.project.id=4a5f475d16704afab2dc8349bebe1cd8&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:23.961316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:01:23.974384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:23.975427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:23.976424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 548/1099] 10.222.0.40 () {56 vars in 1093 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:23.982317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:23.986317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:24.091050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740b005-cdd2-461c-8ee7-991a287c3d43 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:24.132824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:24.133455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:24.133737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:24.134016 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:24.134828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:24.135131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:24.136657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:24.154375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 552/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Sun Jul 31 01:01:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:24.160275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:24.210612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:24.261551 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1dbe-94a2-4437-9a2f-c2ce5eebc087 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:24.301763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:24.302383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:24.302663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:24.302934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:24.368974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:24.370426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:24.415653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:24.466539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 549/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:01:24.472242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:24.532222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:24.571536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096b240-8067-431d-905d-d680bb34e12b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:24.604446 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:24.605141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:24.605419 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:24.605690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:24.615566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:24.617036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:24.631673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:24.632857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:24.633756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:24.633756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:24.633756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:24.633756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:24.633756 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 553/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:24.639488 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:24.737811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cca4a-adac-4792-9db9-6a0ba6cb107d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:24.771487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148471-794d-404c-b938-76660b06ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:24.772137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148471-794d-404c-b938-76660b06ef87 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:24.772451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148471-794d-404c-b938-76660b06ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:24.772732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148471-794d-404c-b938-76660b06ef87 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:24.773428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148471-794d-404c-b938-76660b06ef87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:24.773826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148471-794d-404c-b938-76660b06ef87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:24.775092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148471-794d-404c-b938-76660b06ef87 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:24.786818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 550/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:24.792550 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:24.889932 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de832d-9a8f-4c31-b490-fd31cd454b13 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:24.905005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:24.925889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:24.926534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:24.926821 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:24.927095 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:24.934301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:24.935738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:01:24.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:24.947828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:24.949443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 554/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:24.954395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148471-794d-404c-b938-76660b06ef87 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:24.966379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:25.052380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148471-794d-404c-b938-76660b06ef87 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:25.086768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:25.087395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:25.087681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:25.087962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:25.088848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:25.089072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:25.090592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe4ad4-a43a-451d-b07b-0e38a83749d5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:25.103493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 551/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:25.110130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:25.211822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930068ec-7cde-4eac-a42d-ed008cc68370 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:25.243243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:25.243855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:25.244133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:25.244436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:25.245817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] RBAC: Adding query filter params (role.id=4614644ededa4bab99725c11d75162ff, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=d7b7ff8e53f84c30a43f0f8218ef6d30) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:25.246127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:25.247547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5aff8-632b-48a7-ab31-7661753178ad None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:25.253251 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 555/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:25 2022] GET /identity/v3/role_assignments?user.id=d7b7ff8e53f84c30a43f0f8218ef6d30&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=4614644ededa4bab99725c11d75162ff => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:26.011832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082129-19cc-4ad2-a840-22c299bca397 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:26.012393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082129-19cc-4ad2-a840-22c299bca397 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:26.012393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082129-19cc-4ad2-a840-22c299bca397 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:26.014055 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 552/1107] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:26.019665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:26.020108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:26.020215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:26.039192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:26.040460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:26.071607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:26.109763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 556/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:26.133786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2082129-19cc-4ad2-a840-22c299bca397 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:26.200455 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:26.233491 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2082129-19cc-4ad2-a840-22c299bca397 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:26.265733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:26.266309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:26.266593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:26.266869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:26.268013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:26.269467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654680-156c-4957-97ba-9414ddbb9429 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:26.271053 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 553/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:26.277590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:26.381266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fd40-8059-44af-8815-c7533e17b022 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:26.414879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:26.415489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:26.415767 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:26.416037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:26.416749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:26.418172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14ebf2-3407-449a-acb1-a548f749fd77 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:26.438396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 557/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:01:26 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:28.443428 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5fbb-2719-47a6-b270-465a7d663d33 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:28.443977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5fbb-2719-47a6-b270-465a7d663d33 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:28.444071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a5fbb-2719-47a6-b270-465a7d663d33 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:28.445389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 554/1111] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:28.451164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:28.451656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:28.452135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:28.477803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:28.479503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:28.499908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:28.555627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 558/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:28.579477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a5fbb-2719-47a6-b270-465a7d663d33 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:28.677075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a5fbb-2719-47a6-b270-465a7d663d33 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:28.709874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:28.710439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:28.710720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:28.710991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] PATH_INFO: `/v3/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:28.712430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] RBAC: Authorizing `identity:get_role(role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:28.713811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:28.715654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 555/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:28 2022] GET /identity/v3/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:28.721577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:28.824557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30f97-1e93-4035-9bdd-7274a9b725d9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:28.863895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:28.864567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:28.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:28.865197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] PATH_INFO: `/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:28.878586 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b49bfd0beb4dc4871a83db9fa91af3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:28.880032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:28.881711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 559/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:28 2022] GET /identity/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:28.889220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:28.894331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:28.992185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6094-e3cc-49a4-a8f4-28e655c1efb5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:29.029815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:29.030446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:29.030734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:29.031014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:29.097603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:29.099090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:29.101814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:29.202175 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 556/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:29.208546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:29.225313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:29.310695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6fdd-44a2-46e5-87e0-795ced14cc24 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:29.342722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:29.343355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:29.343638 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:29.343913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:29.345089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:29.346512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a01e29-e9af-4a6d-b0d2-1d8ad4fd450e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:29.348151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 560/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:29 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:29.354372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:29.451405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cf7f-b16a-46d3-8a53-3cfbc37aaa21 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:29.453745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:29.484654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:29.485270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:29.485556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:29.485836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:29.486622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=4a5f475d16704afab2dc8349bebe1cd8, user.id=f2b49bfd0beb4dc4871a83db9fa91af3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:29.486935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:29.488397 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b978-5825-49a0-b3db-2b19a24d4fed None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:29.493659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 557/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:29 2022] GET /identity/v3/role_assignments?user.id=f2b49bfd0beb4dc4871a83db9fa91af3&scope.project.id=4a5f475d16704afab2dc8349bebe1cd8&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:31.498908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f18c9-0566-49e5-b7cb-2a5fd4931831 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:31.499531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f18c9-0566-49e5-b7cb-2a5fd4931831 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:31.499531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f18c9-0566-49e5-b7cb-2a5fd4931831 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:31.500865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 561/1118] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:31.506198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:31.506723 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:31.506824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:31.524533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:31.525745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:31.589964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 558/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:31.613082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f18c9-0566-49e5-b7cb-2a5fd4931831 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:31.693439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:31.714161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f18c9-0566-49e5-b7cb-2a5fd4931831 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:31.747153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:31.747800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:31.748085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:31.748398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] PATH_INFO: `/v3/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:31.749875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] RBAC: Authorizing `identity:get_role(role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:31.751192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:31.752715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 562/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:31 2022] GET /identity/v3/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:31.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:31.849901 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:31.853930 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b669e-8455-4a06-b731-ae55b3cd0d68 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:31.887031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:31.887689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:31.887976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:31.888285 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] PATH_INFO: `/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:31.889471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b49bfd0beb4dc4871a83db9fa91af3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:31.890912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:31.892587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 559/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:31 2022] GET /identity/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:31.898516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:31.996468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45421c7c-da74-42a3-9d01-56f2e807bc32 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:32.030541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:32.031110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:32.031396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:32.031677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:32.032865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:32.034310 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1380bce-2215-4991-9d5c-79411090b394 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:32.035978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 563/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:31 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:32.042529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:32.141323 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488e4ff-bcd0-4875-ad01-671cd8c0fc48 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:32.174747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:32.175427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:32.175711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:32.175990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8/users/f2b49bfd0beb4dc4871a83db9fa91af3/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:32.178186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5f475d16704afab2dc8349bebe1cd8, user_id=f2b49bfd0beb4dc4871a83db9fa91af3, role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:32.179617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7857-918f-4184-905e-24658a4be586 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:32.192732 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 560/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:01:32 2022] PUT /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8/users/f2b49bfd0beb4dc4871a83db9fa91af3/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:01:34.193225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1119-9aa3-46f8-9146-14522614d62a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:34.193839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1119-9aa3-46f8-9146-14522614d62a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:34.193839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a1119-9aa3-46f8-9146-14522614d62a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:34.195104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 564/1124] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:34.200830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:34.201250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:34.201360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:34.218809 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:34.219988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:34.239659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:34.286660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 561/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:34.310331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a1119-9aa3-46f8-9146-14522614d62a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:34.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:34.410567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a1119-9aa3-46f8-9146-14522614d62a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:34.444230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:34.444897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:34.445182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:34.445460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] PATH_INFO: `/v3/roles/e574bfe2752b4f9f972f4100baf5d36c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:34.446892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] RBAC: Authorizing `identity:get_role(role_id=e574bfe2752b4f9f972f4100baf5d36c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:34.448300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:34.449627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 565/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:34 2022] GET /identity/v3/roles/e574bfe2752b4f9f972f4100baf5d36c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:34.455454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:34.551412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89cbf6-1909-41fa-b639-bfd84ca9219c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:34.584761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:34.585392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:34.585679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:34.585955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] PATH_INFO: `/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:34.587106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] RBAC: Authorizing `identity:get_user(user_id=f2b49bfd0beb4dc4871a83db9fa91af3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:34.588556 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:34.590183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 562/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:34 2022] GET /identity/v3/users/f2b49bfd0beb4dc4871a83db9fa91af3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:34.595898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:34.676586 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:34.692709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f603-7617-4b8f-b6e2-5212b949750d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:34.724574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:34.725184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:34.725465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:34.725736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:34.790105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:34.791592 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:34.874649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:34.891048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 566/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:34.897308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:34.923416 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:34.998522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637d12-3cff-46e3-a83b-30785f096a4f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:35.030824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:35.031469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:35.031755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:35.032034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] PATH_INFO: `/v3/projects/4a5f475d16704afab2dc8349bebe1cd8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:35.033214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] RBAC: Authorizing `identity:get_project(project_id=4a5f475d16704afab2dc8349bebe1cd8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:35.034646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d277d-2ed7-4ab9-adec-531e5d64e54d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:35.036349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 563/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:34 2022] GET /identity/v3/projects/4a5f475d16704afab2dc8349bebe1cd8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:35.043123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:35.140789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770ada-8085-4e60-b865-8610fc953a4e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:35.174551 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:35.175172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:35.175460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:35.175739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:35.176568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] RBAC: Adding query filter params (role.id=e574bfe2752b4f9f972f4100baf5d36c, scope.project.id=4a5f475d16704afab2dc8349bebe1cd8, user.id=f2b49bfd0beb4dc4871a83db9fa91af3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:35.176882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:35.178309 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bad1b7-7f6e-42e9-b042-69712e84d364 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:35.184703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 567/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:35 2022] GET /identity/v3/role_assignments?user.id=f2b49bfd0beb4dc4871a83db9fa91af3&scope.project.id=4a5f475d16704afab2dc8349bebe1cd8&role.id=e574bfe2752b4f9f972f4100baf5d36c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:37.184645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69924683-6b04-4cbf-83b4-c951afae4803 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:37.185129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69924683-6b04-4cbf-83b4-c951afae4803 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:37.185238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69924683-6b04-4cbf-83b4-c951afae4803 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:37.186555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 564/1131] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:37.191625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:37.192050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:37.192181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:37.210966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:37.212217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:37.257996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:37.282706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 568/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:37.305617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69924683-6b04-4cbf-83b4-c951afae4803 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:37.396283 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:37.406173 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69924683-6b04-4cbf-83b4-c951afae4803 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:37.439194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:37.439826 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:37.440114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:37.440424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:37.441574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:37.443008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b325-c099-44c7-9265-6e3ee01fef5c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:37.444626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 565/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:37.450551 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:37.554237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143595b-8837-4c86-8cda-6f763abdf97b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:37.592753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:37.593385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:37.593666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:37.593942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:37.594636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:37.596074 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde68f3-fa8b-4852-9768-8ae8dcdf20a5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:37.624067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 569/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:37 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:39.647661 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463c794-279e-4da0-b7da-06ecb0d50056 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:39.648238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463c794-279e-4da0-b7da-06ecb0d50056 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:39.648356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463c794-279e-4da0-b7da-06ecb0d50056 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:39.649744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 566/1135] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:39.655413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:39.655823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:39.655975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:39.674560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:39.675753 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:39.699605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:39.742109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 570/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:39.767680 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463c794-279e-4da0-b7da-06ecb0d50056 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:39.866257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463c794-279e-4da0-b7da-06ecb0d50056 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:39.899568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:39.900137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:39.900447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:39.900725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:39.901914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:39.903349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3de64-38ae-45e8-a136-44534a6e2737 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:39.904980 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 567/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:39.910797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:40.008282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d4bee-2ac2-45ba-8937-e204a3f9892e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:40.040899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:40.041513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:40.042351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:40.042625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:40.043315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:40.044775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365546-4b6e-4179-882b-915eeadae422 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:40.065149 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 571/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:01:39 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:01:42.071214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1ec4-65ca-4775-83bf-8fa9ab002cd1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.071747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1ec4-65ca-4775-83bf-8fa9ab002cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.071842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1ec4-65ca-4775-83bf-8fa9ab002cd1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.073652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 568/1139] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:42.078852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.079274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.079386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.097857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:42.099037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:42.109628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:42.165700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 572/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:42.188974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1ec4-65ca-4775-83bf-8fa9ab002cd1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:42.216766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:42.288766 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1ec4-65ca-4775-83bf-8fa9ab002cd1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:42.322227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:42.322808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.323096 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.323375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.333121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:42.338071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:42.339717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:42.340711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 569/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:42.346051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:42.447561 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b09bad-c4cc-44bb-acb4-6cbb054c1023 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:42.483560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:42.484495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.484786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.485063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.485942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:42.486337 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:42.488002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:42.498141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 573/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:42.504028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:42.591378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:42.605441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811291-f391-4bf9-93c5-bd19f45a5e03 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:42.641898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:42.642543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.642830 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.643111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] PATH_INFO: `/v3/users/fca972bdc16b4414b1beff2d10d53068` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.659051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] RBAC: Authorizing `identity:get_user(user_id=fca972bdc16b4414b1beff2d10d53068)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:42.660534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:42.662321 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 570/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:42 2022] GET /identity/v3/users/fca972bdc16b4414b1beff2d10d53068 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:42.668144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:42.681713 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:42.779697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e842530-a5b1-404c-a155-3323fc4037d3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:42.814580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:42.815200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:42.815484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:42.815758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:42.889710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:42.891200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:42.904352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:43.000536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 574/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:43.006426 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:43.107948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc1628-7338-4993-af4e-20d2bd0295cc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:43.145356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:43.145971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:43.146256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:43.146535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] PATH_INFO: `/v3/projects/d9de0e4b44564216b5762727c0537aa6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:43.147695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] RBAC: Authorizing `identity:get_project(project_id=d9de0e4b44564216b5762727c0537aa6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:43.149164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ac962-995b-417e-b260-29d88e0fa700 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:43.150872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 571/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:43 2022] GET /identity/v3/projects/d9de0e4b44564216b5762727c0537aa6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:43.159762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:43.258760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49db4-7326-4f8c-871e-35f6d1060437 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:43.268377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:43.292234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:43.292870 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:43.293148 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:43.293420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:43.294196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=d9de0e4b44564216b5762727c0537aa6, user.id=fca972bdc16b4414b1beff2d10d53068) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:43.294504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:43.295923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19defcc9-59e3-42f8-883b-bf57a851dc8d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:43.301177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 575/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:43 2022] GET /identity/v3/role_assignments?user.id=fca972bdc16b4414b1beff2d10d53068&scope.project.id=d9de0e4b44564216b5762727c0537aa6&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:45.281675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db4cd-f4cb-4357-8e4e-726bf8e95ed1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.282199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db4cd-f4cb-4357-8e4e-726bf8e95ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.282294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db4cd-f4cb-4357-8e4e-726bf8e95ed1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.283604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 572/1147] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:45.288885 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.289293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.289444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.307899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:45.309160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:45.372743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 576/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:45.395616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6db4cd-f4cb-4357-8e4e-726bf8e95ed1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:45.411129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:45.494160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6db4cd-f4cb-4357-8e4e-726bf8e95ed1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:45.527302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:45.527936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.528230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.528607 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.538273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:45.543246 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:45.544464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:45.545448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 573/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:45.550460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:45.646962 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c457a1-a2d7-4947-8ba7-0c58f7f5256a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:45.648410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:45.680974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:45.681585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.681864 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.682913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.683632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:45.683915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:45.685308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:45.693051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 577/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:45.698934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:45.770951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:45.795704 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7852fb-81c9-4b34-be8b-1f70420291cd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:45.827851 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:45.828509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.828792 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.829063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] PATH_INFO: `/v3/users/fca972bdc16b4414b1beff2d10d53068` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.830202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] RBAC: Authorizing `identity:get_user(user_id=fca972bdc16b4414b1beff2d10d53068)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:45.831612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:45.833220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 574/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:45 2022] GET /identity/v3/users/fca972bdc16b4414b1beff2d10d53068 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:45.838974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:45.937355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a85aa-d63b-4f04-861b-915ddce96894 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:45.971780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:45.974307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:45.974610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:45.974895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] PATH_INFO: `/v3/projects/d9de0e4b44564216b5762727c0537aa6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:45.976089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] RBAC: Authorizing `identity:get_project(project_id=d9de0e4b44564216b5762727c0537aa6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:45.977566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfb537-6413-4dd3-8669-b97c8e8680ff None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:45.979780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 578/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:45 2022] GET /identity/v3/projects/d9de0e4b44564216b5762727c0537aa6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:45.985867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:46.081810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5d58-301b-41c2-8e46-b6666dcc5a42 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:46.114198 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:46.114864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:46.115144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:46.115419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] PATH_INFO: `/v3/projects/d9de0e4b44564216b5762727c0537aa6/users/fca972bdc16b4414b1beff2d10d53068/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:46.117362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] RBAC: Authorizing `identity:create_grant(project_id=d9de0e4b44564216b5762727c0537aa6, user_id=fca972bdc16b4414b1beff2d10d53068, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:46.118791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4792c0-e8fe-4c61-ade9-910141249a4b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:46.132796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 575/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:01:45 2022] PUT /identity/v3/projects/d9de0e4b44564216b5762727c0537aa6/users/fca972bdc16b4414b1beff2d10d53068/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:01:48.156351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589bad-9730-43a1-8d2f-ff0f5a627474 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.156798 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589bad-9730-43a1-8d2f-ff0f5a627474 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.156888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589bad-9730-43a1-8d2f-ff0f5a627474 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.158220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 579/1154] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:48.163561 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.163984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.164120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.170466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.184406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:48.185607 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:48.249189 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 576/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:48.275221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea589bad-9730-43a1-8d2f-ff0f5a627474 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.310518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.381473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea589bad-9730-43a1-8d2f-ff0f5a627474 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.414204 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:48.414787 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.415072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.415346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.426207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:48.431175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:48.432358 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:01:48.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 580/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:48.438710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.534602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6d87-fc9b-4d99-80ca-3818fcf5ca71 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.564049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.571808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:48.572473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.572764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.573045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.576062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:48.576433 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:48.577820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:48.586842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 577/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:48.593417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.685454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.694749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced100a-b528-47ff-bf6b-f41f988d15f0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.729025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:48.729659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.729968 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] PATH_INFO: `/v3/users/fca972bdc16b4414b1beff2d10d53068` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.731388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] RBAC: Authorizing `identity:get_user(user_id=fca972bdc16b4414b1beff2d10d53068)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:48.732839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:48.734433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 581/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/users/fca972bdc16b4414b1beff2d10d53068 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:48.740407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.837087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0b0da-635b-4531-a4b9-d4ca67b35e27 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.869295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:48.869918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.870205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.870482 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.933723 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.941821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:48.943223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.038582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 578/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:49.044555 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.142352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ac814-5690-4513-b2bb-304f7000e4bf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.174492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.175133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.175417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.175695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] PATH_INFO: `/v3/projects/d9de0e4b44564216b5762727c0537aa6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.176860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] RBAC: Authorizing `identity:get_project(project_id=d9de0e4b44564216b5762727c0537aa6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.178290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2bf0-ade9-4d10-9fa4-5d40be7b1a4b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.179950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 582/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/projects/d9de0e4b44564216b5762727c0537aa6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:49.187130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.289267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:49.297336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57f00-2d8d-4a5c-ad33-b590b513f3f4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.331849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.332496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.332784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.333064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.333854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=d9de0e4b44564216b5762727c0537aa6, user.id=fca972bdc16b4414b1beff2d10d53068) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:49.334170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.335598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6df91-0cc4-4cd7-b9b6-9d727c8f6a40 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.341940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 579/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/role_assignments?user.id=fca972bdc16b4414b1beff2d10d53068&scope.project.id=d9de0e4b44564216b5762727c0537aa6&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:51.347605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1d10-b468-424a-862b-2a9e5f2c444e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.348174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1d10-b468-424a-862b-2a9e5f2c444e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.348174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1d10-b468-424a-862b-2a9e5f2c444e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.349538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 583/1162] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:51.355417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.355891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.373697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:51.374882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:51.440577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 580/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:51.462359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1d10-b468-424a-862b-2a9e5f2c444e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:51.491528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:51.564084 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1d10-b468-424a-862b-2a9e5f2c444e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:51.596690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:51.597304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.597584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.597858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.665153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:51.666641 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:51.692560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:51.763255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 584/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:01:51.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:51.853844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:51.866059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd180e-5deb-415f-bb02-39ee3b6ce7e6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:51.904232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:51.904905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.905191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.905472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.912035 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:51.913508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5ed8d92f-41b4-4f2a-aab7-9a0bd0ffd6bf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:51.924733 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:51.925943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:01:51.927000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 581/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:01:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:51.932039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.029785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df31a-fdac-4717-9c52-770b431803e6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.054294 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.062879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.063490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.063769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.064038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.064747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:52.065048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:52.066433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dca29-3c53-402c-adad-6c617ecd066d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:52.073912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 585/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Sun Jul 31 01:01:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:54.074003 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b94-ef1f-4c9c-b2c9-4a5ee239537d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:54.074597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b94-ef1f-4c9c-b2c9-4a5ee239537d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:54.074597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b94-ef1f-4c9c-b2c9-4a5ee239537d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:54.075914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 582/1167] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:54.081185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0f14-5ab5-4785-ae39-c1da3e6f4092 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:54.081583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0f14-5ab5-4785-ae39-c1da3e6f4092 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:54.081746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a0f14-5ab5-4785-ae39-c1da3e6f4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:54.099326 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-322a0f14-5ab5-4785-ae39-c1da3e6f4092 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:54.100543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-322a0f14-5ab5-4785-ae39-c1da3e6f4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:54.165959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 586/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:54.189745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1889b94-ef1f-4c9c-b2c9-4a5ee239537d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:54.286565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1889b94-ef1f-4c9c-b2c9-4a5ee239537d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:54.320317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:54.320954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:54.321237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:54.321514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:54.322220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:54.323580 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759415ff-6eb2-44d8-b240-2b093f6a8b08 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:54.340474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 583/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Sun Jul 31 01:01:54 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:56.347238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dcca-71fb-4f4d-9016-d3081ee889b8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.347765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dcca-71fb-4f4d-9016-d3081ee889b8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.347856 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dcca-71fb-4f4d-9016-d3081ee889b8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.349163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 587/1170] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:56.354395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.354834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.354995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.372840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:56.374036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:56.375987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.440966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 584/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:56.465038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9dcca-71fb-4f4d-9016-d3081ee889b8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.562804 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9dcca-71fb-4f4d-9016-d3081ee889b8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.585629 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.597210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.597853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.598134 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.598410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] PATH_INFO: `/v3/domains/623c3a6c88be44c7a382a7efb2fc6654` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.608691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=623c3a6c88be44c7a382a7efb2fc6654)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.610136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73024183-a33b-4a32-b231-44cb7a5f9651 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.611742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 588/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/domains/623c3a6c88be44c7a382a7efb2fc6654 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:56.617684 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.712737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f6eb-bcbc-4cb8-8459-01f1d81617fd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.745133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.745803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.746072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.746316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.746998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.748534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854c58a-5289-4906-ae46-7f021e873a12 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.757774 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.774860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 585/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:56 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:58.792291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb25c2-a433-4c0e-a487-725c40583fc8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.792854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb25c2-a433-4c0e-a487-725c40583fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.792854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb25c2-a433-4c0e-a487-725c40583fc8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.794181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 589/1174] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:58.799345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.799770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.799913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.818649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:58.819838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:58.885074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 586/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:01:58.910557 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb25c2-a433-4c0e-a487-725c40583fc8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:59.011570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb25c2-a433-4c0e-a487-725c40583fc8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:59.046484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:59.047047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:59.047328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:59.047600 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] PATH_INFO: `/v3/domains/623c3a6c88be44c7a382a7efb2fc6654` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:59.048761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=623c3a6c88be44c7a382a7efb2fc6654)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:59.050192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f766b-9f89-413c-964e-bf52a2260767 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:59.051780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 590/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Sun Jul 31 01:01:58 2022] GET /identity/v3/domains/623c3a6c88be44c7a382a7efb2fc6654 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:59.057922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:59.159296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c05b9-5fdb-425f-9e0e-9910f4f65515 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:59.186002 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:59.201468 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:59.202103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:59.202446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:59.202849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:59.203700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:59.205180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26960-c38c-4039-8f36-53583bb08ea7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:59.226308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 587/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:01:59 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:01.283202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bafe-1f65-4562-928b-6b7fd7864e9d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.283725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bafe-1f65-4562-928b-6b7fd7864e9d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.283725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72bafe-1f65-4562-928b-6b7fd7864e9d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.285108 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 591/1178] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:01.290279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.290695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.290855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.309337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:01.310539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:01.375972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 588/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:02:01.400023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72bafe-1f65-4562-928b-6b7fd7864e9d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:01.453788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:01.502766 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72bafe-1f65-4562-928b-6b7fd7864e9d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:01.535053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:01.535691 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.535975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.536277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.546749 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:01.551710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:01.552822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:02:01.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 592/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:01.560118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:01.653475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b98de-1131-49f6-8a9a-0515891e760a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:01.660767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:01.688654 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:01.689278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.689563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.689839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.690553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:01.690859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:01.692273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:01.700822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 589/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:01.706850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:01.822207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b4490-8296-4012-93a1-1f15e827cf5f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:01.833060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:01.857740 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:01.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.858679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.858951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] PATH_INFO: `/v3/users/6849409c76624202ba44474db8ff1677` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.872473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] RBAC: Authorizing `identity:get_user(user_id=6849409c76624202ba44474db8ff1677)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:01.873958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:01.880299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 593/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:01 2022] GET /identity/v3/users/6849409c76624202ba44474db8ff1677 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:01.881585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:01.982054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e5a54-da7c-41e1-97bc-4655316ac9c8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.015124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.015751 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.016039 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.016344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.048718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.085142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.087351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.187489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 590/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:02:02.193711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.289458 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb899-3ac1-452f-a634-d77624f0007e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.324379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.325022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.325304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.325580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] PATH_INFO: `/v3/projects/b909cb2fc6e942dfac5ac03feef53e84` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.326734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] RBAC: Authorizing `identity:get_project(project_id=b909cb2fc6e942dfac5ac03feef53e84)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.328170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ab1b2-acb5-4224-b7ca-b775536ec3ad None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.329849 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 594/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/projects/b909cb2fc6e942dfac5ac03feef53e84 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.336149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.400449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.437290 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a167-3955-4ed4-91d2-1d3790a4e6f4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.469217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.469831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.470111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.470383 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.471160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=b909cb2fc6e942dfac5ac03feef53e84, user.id=6849409c76624202ba44474db8ff1677) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:02.471466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.473040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b86b1-e7d8-424c-9f9b-fb9855c63c8f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.479139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 591/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/role_assignments?user.id=6849409c76624202ba44474db8ff1677&scope.project.id=b909cb2fc6e942dfac5ac03feef53e84&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.499696 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb792-3e4d-4c17-9254-c5af575383b0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.500273 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb792-3e4d-4c17-9254-c5af575383b0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.500380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb792-3e4d-4c17-9254-c5af575383b0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.501719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 595/1186] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:04.507064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.507474 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.507616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.526378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:04.527569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:04.592165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 592/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:02:04.614488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb792-3e4d-4c17-9254-c5af575383b0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.649801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.714874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb792-3e4d-4c17-9254-c5af575383b0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.747570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.748210 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.748525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.748807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.758679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:04.764114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:04.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:02:04.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 596/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:04.771409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.831206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.867690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8e01-6112-48bf-be99-5d17fb7f6522 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.903396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.904021 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.904330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.904611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.905328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:04.905634 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.907003 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.914925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 593/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.920824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:05.015283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:05.021598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ead0-0dc3-4dd9-a62a-ddd291eacdfa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:05.053946 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:05.054581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:05.054868 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:05.055145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] PATH_INFO: `/v3/users/6849409c76624202ba44474db8ff1677` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:05.056849 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] RBAC: Authorizing `identity:get_user(user_id=6849409c76624202ba44474db8ff1677)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:05.058566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:05.060159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 597/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/users/6849409c76624202ba44474db8ff1677 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:05.065982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:05.163834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83663459-300e-4b60-a65b-1c5937bfd53c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:05.186025 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:05.197637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:05.198281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:05.198569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:05.198849 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] PATH_INFO: `/v3/projects/b909cb2fc6e942dfac5ac03feef53e84` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:05.200000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b909cb2fc6e942dfac5ac03feef53e84)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:05.201473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb64ee-2239-4042-90e9-bd1f924663d0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:05.203144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 594/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:05 2022] GET /identity/v3/projects/b909cb2fc6e942dfac5ac03feef53e84 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:05.209183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:05.306116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e99e9-adbe-46ce-9f20-7e90a2554446 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:05.340037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:05.340719 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:05.341000 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:05.341271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] PATH_INFO: `/v3/projects/b909cb2fc6e942dfac5ac03feef53e84/users/6849409c76624202ba44474db8ff1677/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:05.343177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] RBAC: Authorizing `identity:create_grant(project_id=b909cb2fc6e942dfac5ac03feef53e84, user_id=6849409c76624202ba44474db8ff1677, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:05.344619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1296a-089d-4001-864c-5daa1b2e7e29 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:05.356877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 598/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:05 2022] PUT /identity/v3/projects/b909cb2fc6e942dfac5ac03feef53e84/users/6849409c76624202ba44474db8ff1677/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:07.352541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2785e-0b4e-4056-8d7e-739cf1e329cc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.353065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2785e-0b4e-4056-8d7e-739cf1e329cc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.353065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2785e-0b4e-4056-8d7e-739cf1e329cc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.354996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 595/1193] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:07.360020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.360421 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.360607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.379603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:07.380831 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:07.397723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.447034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 599/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:02:07.471163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2785e-0b4e-4056-8d7e-739cf1e329cc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.572240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2785e-0b4e-4056-8d7e-739cf1e329cc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.604786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.605417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.605697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.605970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.615538 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:07.620548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:07.621642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:02:07.622695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 596/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:07.627765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.723290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3d50-a16b-40ce-bec3-0d9d8e72ec7d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.757711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.758342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.758625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.758903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.760209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:07.760549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.761919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.769966 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 600/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.829417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.875070 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4b6f-e3c0-401a-90bd-e7a9e8940127 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.910419 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.911073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.911368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.911649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] PATH_INFO: `/v3/users/6849409c76624202ba44474db8ff1677` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.912850 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] RBAC: Authorizing `identity:get_user(user_id=6849409c76624202ba44474db8ff1677)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.914307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.915949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 597/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/users/6849409c76624202ba44474db8ff1677 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.921780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.940711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.020672 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c668e-1e6a-476c-996f-8844f6085cb8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.052861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.053481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.053764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.054041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.121423 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.122897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.139494 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.218712 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 601/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:02:08.224615 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.320740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889215e-94c8-4605-b998-e570ef75ae3e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.340575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.354905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.355549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.355838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.356111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] PATH_INFO: `/v3/projects/b909cb2fc6e942dfac5ac03feef53e84` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.357294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b909cb2fc6e942dfac5ac03feef53e84)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.358709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533575ad-a0a3-4b79-9b07-5a02711805c2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.360391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 598/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/projects/b909cb2fc6e942dfac5ac03feef53e84 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.366531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.461017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458b943-fc8b-4a5c-913d-bb7a07b6e9a3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.477069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.495022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.495634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.495915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.496187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.496992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=b909cb2fc6e942dfac5ac03feef53e84, user.id=6849409c76624202ba44474db8ff1677) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:08.497297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.498715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7120ef-8ae7-4b07-a1f9-5baebaa778a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.504283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 602/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/role_assignments?user.id=6849409c76624202ba44474db8ff1677&scope.project.id=b909cb2fc6e942dfac5ac03feef53e84&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:18.350638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:18.501769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=10 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.856700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb1b5-4d4f-480f-9825-4cb0c13bb710 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.857342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb1b5-4d4f-480f-9825-4cb0c13bb710 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.857342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fb1b5-4d4f-480f-9825-4cb0c13bb710 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.858574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 599/1201] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:03.864487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.865050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.865226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.886362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:03.887920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:03.992409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 603/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:04.016317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb1b5-4d4f-480f-9825-4cb0c13bb710 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.167885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fb1b5-4d4f-480f-9825-4cb0c13bb710 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.210128 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.211288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.211703 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.211990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.225878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.227468 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:04.246706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.247883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:04.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:04.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:04.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 600/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.254170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.395914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2460aad-7af4-4afa-8e17-a957087b385a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.442857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.454408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.455094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.455464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.455854 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.456671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.457218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.458822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951aeb-5bb4-406f-8c3b-eb3e84207234 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.474978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 604/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.480412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.553313 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.619942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02551-740f-48f6-8a21-7f2e072757fc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.676351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.677054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.677422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.677837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.678779 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.680443 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425c06f-f6ea-4c2d-ae82-bf94ecc1ae66 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.705102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 601/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Sun Jul 31 01:03:04 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:07.224403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8e71-99f9-426e-824a-b0c76c0d11b3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.225030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8e71-99f9-426e-824a-b0c76c0d11b3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.225030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8e71-99f9-426e-824a-b0c76c0d11b3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.226320 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 605/1206] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:07.233588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.233588 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.234637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.256494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:07.258678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:07.344146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 602/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:07.372163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b8e71-99f9-426e-824a-b0c76c0d11b3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.501319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b8e71-99f9-426e-824a-b0c76c0d11b3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.550892 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.552003 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.552768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.553269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.571993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:07.581761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:07.582805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:07.583675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:07.589376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 606/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:07.590779 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.643958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.728391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343795f-e8a2-449d-8cad-be025d227ad5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.790606 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.791060 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.791235 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.791528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.792245 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:07.792681 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.794432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.806188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 603/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:07.813303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.884903 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.949527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb2ad-47d5-4830-a8cc-22e25a60f3bf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.991714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.992480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.992770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.993050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.005209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.006956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:08.025457 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.026459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.027939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:08.027939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:08.027939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:08.027939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:08.031580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 607/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:08.033344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.156401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.159642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d750f1-fc81-43f8-a65c-9ca101e56ebe None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.201738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.202386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.202632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.202906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.203600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:08.203905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.205357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.218705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 604/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:08.225037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.346488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864f3e4-dbb8-4011-b70b-8170fd5dedc0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.348205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.386944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.387521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.387800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.388069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.396886 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:08.412917 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.414266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:08.415239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 608/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:08.420384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767baab-9d22-4bc7-97cc-792b47559988 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.574232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.574863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.575145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.575422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.576243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:08.576554 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.577995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.597159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 605/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:08.603235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.721431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5c64-bc0b-478f-a420-5973002b81b9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.764288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.764884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.765433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.765821 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.809581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.861039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.862718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.991791 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 609/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:08.997871 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.018706 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.117403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe6ba-7d1b-45e9-a3cd-d2aff626e7d4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.160711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.161411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.161745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.162070 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.174943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.176600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:09.196043 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:09.197220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:09.198331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:09.198331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:09.198331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:09.198331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:09.198331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 606/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:09.204877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.275935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.321378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c2ff4-9031-47d6-b6b0-2ca91247e247 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.367324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.368059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.368482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.368818 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.369679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.370022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.371677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.387104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 610/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:09.393546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.492969 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.534716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fb2f-ff44-48ff-8b11-f56f9319feff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.575746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.576686 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.577175 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.577647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.585885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.587665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:09.601869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:09.603243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:09.604337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:09.608118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 607/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:09.609246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.721681 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff048a73-25ff-45a8-ab73-855a2eba02ad None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.749582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.766931 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.767974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.768183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.768709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.769791 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.770228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.772103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a0aba-4d18-4d04-86fb-79580697d793 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.789202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 611/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:09.795332 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.909135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659abb5-16f4-4f42-993a-9e82dc8a5797 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.938782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.946180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.946924 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.947280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.947624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=f392d45213bd42c38601f9c654350526) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.949081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.950642 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede74129-95e2-4509-815c-ed750fd32a76 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.956646 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 608/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/role_assignments?user.id=f392d45213bd42c38601f9c654350526&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:11.963918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec004-b129-43a5-b698-5feffee624d8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.964748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec004-b129-43a5-b698-5feffee624d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.964748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec004-b129-43a5-b698-5feffee624d8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.965826 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 612/1220] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:11.971117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.971590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.971712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.995356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:11.996771 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:12.077550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 609/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:12.099264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ec004-b129-43a5-b698-5feffee624d8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.215289 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ec004-b129-43a5-b698-5feffee624d8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.261342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.261993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.262541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.275234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:12.280910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.282163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:12.283244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 613/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.288000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.401956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4457e-8e1a-4a7e-a895-f9f30e3441be None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.427635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.439295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.439970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.440275 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.440563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.441430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.441919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.443668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.452571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 610/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.458761 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.508811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.577570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9739b-2835-400f-8e54-69e8e8bc9532 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.611339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.611985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.612276 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.612570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.623197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.624807 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:12.641177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.642372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.643651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:12.643651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:12.643651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.643651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:12.643651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 614/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.648895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.762003 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372aa2-5a0a-47ad-bce1-bdcc28cbe9a3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.805720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.806350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.806639 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.806917 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.807619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.808181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.810232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.823261 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 611/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.828857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.946723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.956439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4ae3-9a61-4094-a55a-72c91c73de94 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.013593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.014945 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.015559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.016037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.029728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.032394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:13.054979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.056022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:13.057061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:13.057606 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 615/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.064207 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.118501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.186139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f9b6-fa0e-4a6b-bb28-a4e56056ea8e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.225239 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.226679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.226974 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.227280 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.228199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.228655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.230691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.250171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 612/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.256123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.363226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef536-4050-4217-8b73-12bde6c94850 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.400559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.401226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.401491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.401767 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.416482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.418167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:13.436017 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.437193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.438303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:13.438303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:13.438303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.438303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:13.439087 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 616/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.445692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.558863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700ec8-17b3-4756-9463-7953d42aee82 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.561357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.598559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.599257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.599543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.599821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.600549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.601362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.602906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.615464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 613/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.622189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.633911 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.740811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb431a-e1f7-48af-9a80-7bbfd08ea4e1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.795517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.797073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.797408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.797784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.808479 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.810538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:13.824307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.825997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:13.827342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 617/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.832104 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.945447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a057-8225-4f37-89e0-2e9a86564239 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.981863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.982687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.982991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.983387 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.987268 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954b77-ee40-4bc6-9757-56706c0f48b1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.005616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 614/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:14.014078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.088559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.129916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb95f92-a75c-4148-ad52-ef271ca1c39c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.170991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.171769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.172160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.172556 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/f392d45213bd42c38601f9c654350526/roles/6b72b2813f864e7e8d92310aa80e1641` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.190661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=f392d45213bd42c38601f9c654350526, role_id=6b72b2813f864e7e8d92310aa80e1641)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.192113 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181649e0-a1d1-4483-b042-49d61e0fc172 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.206220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 618/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:14 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/f392d45213bd42c38601f9c654350526/roles/6b72b2813f864e7e8d92310aa80e1641 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:16.381215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f55-02f8-46c7-ad57-074c0a1a6233 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.381821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f55-02f8-46c7-ad57-074c0a1a6233 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.381962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f55-02f8-46c7-ad57-074c0a1a6233 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.384028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 615/1233] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:16.389837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.390402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.390483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.410512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:16.411855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:16.483082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 619/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:16.506156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0f55-02f8-46c7-ad57-074c0a1a6233 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.535178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.617904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0f55-02f8-46c7-ad57-074c0a1a6233 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.654555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.655135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.655423 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.655699 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.666087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:16.671034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:16.673304 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:16.674583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 616/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:16.678406 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.728315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.801944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250a7f-b2a6-42bd-bee9-5544a1641d37 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.839351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.839984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.840292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.840576 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.841291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:16.841599 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.842969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.852035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 620/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:16.857923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.948568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.966694 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cc34-692c-4a6a-8a49-a1d3a7693785 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.002317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.002964 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.003290 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.003542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.014655 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.016193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:17.035077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:17.036532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:17.037658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:17.037658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:17.037658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:17.037658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:17.037658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 617/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:17.043133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.154197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2730fa-e749-415e-a3ff-8e9b2b6c9f42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.164381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.192790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.193424 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.193710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.193984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.195291 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.195571 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.197034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.216948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 621/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.218282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.360587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c217f-7da6-4306-ac0b-7847f594b7b8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.414313 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.415333 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.415653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.416076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.419860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.425657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.427327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:17.441564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:17.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:17.444410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 618/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:17.449837 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.566158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5544c11-4296-4680-97be-bf75d7bb93b1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.604195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.605025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.605311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.605567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.606459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.606823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.608432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.629633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 622/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:17.637520 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.764038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4a0f0-d0dd-4231-b575-5b3a99a3effd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.802769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.803380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.803690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.804569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.888903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.896027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.897981 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.024224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 619/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:18.031465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.066521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:18.164159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc747dc1-46e4-4935-8742-cbfb6d8377ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.202874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.203524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.203805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.204080 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.215245 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.216872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:18.236041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:18.237062 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:18.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:18.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:18.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:18.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:18.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 623/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:18.244884 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.362136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:18.371622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8689025-5c39-4f59-8fa1-b5000f4255e5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.419185 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.419870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.420118 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.420327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.423247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:18.423247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.423247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.435638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 620/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:18.443259 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.532706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:18.558263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd66ed7-8314-4a77-bf47-179e7191d52a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.594460 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.595152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.595437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.595716 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.603836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.605394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:18.617105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:18.618115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:18.618994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 624/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:18.625833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.737339 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239ad8-4b9a-495a-a758-b4d4af9a640b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.779462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.780079 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.780386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.780658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.781413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:18.781719 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.783134 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83fa6-53b9-4a03-9daf-2f441579451c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.805518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 621/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:18.809039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.940365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4249e-4a59-4adc-b8f8-55a0d3c925a0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.985026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.985684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.986024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.986306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.987199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] RBAC: Adding query filter params (role.id=6b72b2813f864e7e8d92310aa80e1641, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=f392d45213bd42c38601f9c654350526) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:18.987575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.989118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435c2dc-ebb7-4335-8724-8e3419a647bf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.996748 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 625/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/role_assignments?user.id=f392d45213bd42c38601f9c654350526&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=6b72b2813f864e7e8d92310aa80e1641 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:21.120957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bf09-ad20-499b-b240-7f3ce2a3f806 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.121570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bf09-ad20-499b-b240-7f3ce2a3f806 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.121960 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69bf09-ad20-499b-b240-7f3ce2a3f806 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.123331 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 622/1247] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:21.129564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.130110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.130207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.138157 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.151822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:21.153182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:21.231367 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 626/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:21.257263 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69bf09-ad20-499b-b240-7f3ce2a3f806 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.280609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.394254 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69bf09-ad20-499b-b240-7f3ce2a3f806 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.437458 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.438367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.438824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.439405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.454320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:21.460188 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.461435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:21.462764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 623/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:21.468478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.586378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd364b2-ac48-4304-b4f3-e40628820b28 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.620687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.626602 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.627654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.627880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.628714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:21.629019 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.630521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.639369 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 627/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:21.646214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.737863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.770216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64455-a082-48c7-8dc3-617c3c3f3ca5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.814446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.815214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.815505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.815786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.827717 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.829209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:21.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.846381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:21.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:21.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:21.849008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 624/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.856280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.974827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900e96-7b3a-4ac5-bbbc-91960eaefdeb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.015292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.016115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.016450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.016728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.017611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.018026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.019528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.034240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 628/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.040020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.150169 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d3ac-6c41-4553-8d57-ed7449299e84 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.176693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.186049 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.186694 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.186978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.187256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.194917 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.196467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:22.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:22.208856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:22.210796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 625/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:22.215678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.276864 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.325746 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f45-bc81-4c73-9596-bf1f19685bd9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.373142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.373813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.374102 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.374381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.375246 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.375619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.377187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.400043 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 629/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.406472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.522141 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839d31-526f-426a-9c23-99d1a73b38f7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.562670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.563284 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.563592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.563870 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.636193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.637715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.752567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 626/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:03:22.758106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.868658 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c020a-13ba-47cf-a7cd-ca986c4e8a14 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.882506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.908066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.908774 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.909055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.909332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.920315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.921790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:22.938969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:22.940129 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:22.941380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:22.941380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:22.941380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:22.941380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:22.941380 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 630/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:22.947281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.048316 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.061935 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635883-b616-441f-afdb-08952a60cd3d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.098209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.098832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.099120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.099393 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.100083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.100412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.102585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.114312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 627/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.122239 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.233212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708166ec-c5c8-49cb-88e0-5af5ae9b5f0f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.270065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.270839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.271153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.271431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.279378 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.280874 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:23.294949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:23.296190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:23.297125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 631/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:23.303317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.421939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53581b-5366-4297-9e43-b63e44b6c69b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.465857 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.466756 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.467174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.467618 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.468570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.468946 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.470977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1e405-6b44-4006-90be-c64b6e1c15b6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.487517 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 628/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.495565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.524433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.625762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d688-9271-44fb-9ce7-8fa709596bfd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.661764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.662392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.662710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.662987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.663811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=f392d45213bd42c38601f9c654350526) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.664124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.665726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424404ea-bb5b-475a-9466-865e558e3b8d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.672093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 632/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/role_assignments?user.id=f392d45213bd42c38601f9c654350526&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:25.774378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67d58-11b1-4b06-b0a1-e2de35bf8b5c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.774951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67d58-11b1-4b06-b0a1-e2de35bf8b5c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.775095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67d58-11b1-4b06-b0a1-e2de35bf8b5c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.776810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 629/1261] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:25.784512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.785205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.785754 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:25.811512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:25.877813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 633/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:25.900892 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67d58-11b1-4b06-b0a1-e2de35bf8b5c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.911675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.000414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67d58-11b1-4b06-b0a1-e2de35bf8b5c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.033277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.033856 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.034142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.034420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.044234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:26.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.050190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:26.051349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 630/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:26.056842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.075363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.156528 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816633f-8dc7-40ac-ae85-16d571892008 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.191097 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.191715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.191998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.192306 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.193024 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:26.193332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.194754 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.202513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 634/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:26.208228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.273447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.307061 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4ee5-7d37-48ba-bc40-d261b63ceb26 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.339647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.340311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.340603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.340881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.358250 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.359701 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:26.374702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.375786 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:26.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:26.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:26.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:26.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 631/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:26.381830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.462823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.482621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a94e0-cdc3-4d33-80bc-757ddba2f152 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.515374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.515992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.516304 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.516585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.517274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:26.517582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.518950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.532038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 635/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:26.537867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.634146 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c817720-fcdc-4184-a576-d811939970e5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.653956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.668760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.669402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.669688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.669966 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.677232 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.678700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:26.690403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.691548 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:26.692571 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 632/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:26.697689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.803580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fcb0c-1b39-4e2f-93e5-03561ed7b979 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.837779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.838396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.838675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.838943 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.839725 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:26.840027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.841477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.849855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.860233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 636/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:26.865740 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.965668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec295e-07b1-419c-aa76-f03712ac9aa8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.998237 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.998882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.999170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.999452 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.010244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.011694 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:27.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.027276 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.028301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:27.028301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:27.028301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:27.028301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:27.028301 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 633/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:27.033274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.130070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabfbde-4b33-4a9f-a919-c9f1471a3ce0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.165123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.165741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.166022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.166986 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:27.167292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.168688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.179711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 637/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:27.185545 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.217240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.283344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5443-4455-40f0-9f73-80af2e58d297 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.315565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.316195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.316506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.316782 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.323202 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.324668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:27.336707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:27.338867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 634/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:27.343774 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.399872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.441014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41e72-f3a3-42b7-ba29-0c6e0513d19e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.473396 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.473955 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.474241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.474517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.475264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:27.476151 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.477605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb5931-e526-4a26-9db5-d46391a127c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.489238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 638/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:27.495295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.583354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.592940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd417-1964-4fb8-adf2-b7faeb0ad8aa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.625405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.626069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.626356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.626636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] PATH_INFO: `/v3/projects/c011b2f102644f71ab8895bb88740528/users/f392d45213bd42c38601f9c654350526/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.628585 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c011b2f102644f71ab8895bb88740528, user_id=f392d45213bd42c38601f9c654350526, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.630045 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc62f7d-a5cf-4d44-ad4e-60e8cb1ba3bd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.643954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 635/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:27 2022] PUT /identity/v3/projects/c011b2f102644f71ab8895bb88740528/users/f392d45213bd42c38601f9c654350526/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:29.599642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e072-7353-44d0-a4cf-c1a97b482951 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.600203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e072-7353-44d0-a4cf-c1a97b482951 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.600203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e072-7353-44d0-a4cf-c1a97b482951 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.601623 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 639/1274] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:29.606876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.607257 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.607449 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.626109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:29.627309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:29.692354 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 636/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:29.715653 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e072-7353-44d0-a4cf-c1a97b482951 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.829714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e072-7353-44d0-a4cf-c1a97b482951 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.846647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.863811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.864425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.864710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.864986 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.875431 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:29.880372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:29.881517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:29.882659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 640/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:29.887672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.965477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.985012 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b02e7-7ca5-4394-b5a5-63e4a32ead38 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.020391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.021011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.021287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.021559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.022294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.022590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.023934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.031761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 637/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.037574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.138932 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906267-b5f2-4791-b80b-052d1e292b9a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.172329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.172973 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.173256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.173530 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.184176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.185640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:30.199871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.201957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:30.201957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:30.201957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.201957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:30.201957 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 641/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:30.206864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.304743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5410-25fc-43c0-9dbb-ebf429aecefa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.336934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.337546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.337832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.338109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.338796 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.339105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.340487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.351775 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 638/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.357445 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.388914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.462104 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf183db-28a2-409b-a3cc-15fa4d931993 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.494646 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.495279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.495565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.495842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.503584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.505054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:30.516879 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:30.519263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 642/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:30.523848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.527573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.619672 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1b81d-dfa0-468d-9d49-deaaa6a9fd89 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.652412 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.652959 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.653236 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.653508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.654287 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.654592 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.656004 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.673640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 639/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.680002 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.771103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.781135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216c4a-60a0-4189-8135-bfe15a279006 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.815177 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.815794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.816073 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.816375 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.880979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.882464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.967398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.978402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 643/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:30.984209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.044431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.082389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e45a-715e-4996-823b-209d8e18d87b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.117014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.117653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.117942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.118210 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.128064 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.129542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:31.144008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:31.145190 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:31.146140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:31.146140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:31.146140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:31.146140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:31.146140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 640/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:31.151343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.248432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ca1c0-5810-487f-8b71-8c431414caa9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.282164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.282782 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.283066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.283339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.284028 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.284364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.285735 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.297262 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 644/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:31.302962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.399530 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afc8c-2d55-484b-8a1b-c2e739912cf1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.412507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.432541 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.433439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.433722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.433998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.440515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.442013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:31.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:31.454831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 31 01:03:31.455868 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 641/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:31.461254 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.510080 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.558928 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1396e-0881-463b-b26c-811a1070b2c8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.591978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.592620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.592901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.593171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.593912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.594214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.595633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7edbb3-53ca-4a6c-a3a5-06ee7dd44d2e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.607570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 645/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:31.613623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.711647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed0b67-0f05-4c53-86b2-526c8b227d5e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.743894 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.744537 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.744825 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.745102 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.745882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] RBAC: Adding query filter params (role.id=43e7d1f737a84eeb8c30214ca5ccaae5, scope.project.id=c011b2f102644f71ab8895bb88740528, user.id=f392d45213bd42c38601f9c654350526) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.746193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.747612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdba35-7eb5-458f-bcd7-c9e8331a0aa3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.753241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 642/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/role_assignments?user.id=f392d45213bd42c38601f9c654350526&scope.project.id=c011b2f102644f71ab8895bb88740528&role.id=43e7d1f737a84eeb8c30214ca5ccaae5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:33.835055 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2299-1dfc-478f-a53c-533eba66ea9a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.835692 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2299-1dfc-478f-a53c-533eba66ea9a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.835692 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2299-1dfc-478f-a53c-533eba66ea9a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.836980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 646/1288] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:33.842091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.842542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.842641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.860898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:33.862093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:33.891231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.929624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 643/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:33.952611 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2299-1dfc-478f-a53c-533eba66ea9a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.055737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2299-1dfc-478f-a53c-533eba66ea9a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.070133 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:34.094542 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.095107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.095389 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.095671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.096319 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.097685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:34.106972 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:34.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:34.109023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 647/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:34.114374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.211748 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a3ed-a865-4b05-985f-ea124187486e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.245219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.245838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.246123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.246401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.247076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:34.247386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.248798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5b9e4-c766-4818-894d-f9f12657c04f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.253608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 644/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:34.259438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.368141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c97e-53de-4957-a12d-638f0851f417 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.402282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.402912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.403198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.403476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.404153 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] RBAC: Adding query filter params (type=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:34.404493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.405866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0146-c004-4130-a261-2e9cac3c21cf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.410307 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 648/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:36.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40838-237e-4f29-9343-1409eefe5137 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.413933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40838-237e-4f29-9343-1409eefe5137 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.413933 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a40838-237e-4f29-9343-1409eefe5137 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.415248 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 645/1293] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:36.420299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f69b6-74d7-480f-8900-3eaa5054cb18 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.420717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f69b6-74d7-480f-8900-3eaa5054cb18 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.420861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f69b6-74d7-480f-8900-3eaa5054cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.439322 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-573f69b6-74d7-480f-8900-3eaa5054cb18 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:36.440539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-573f69b6-74d7-480f-8900-3eaa5054cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:36.469330 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:36.505130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 649/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:36.528148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a40838-237e-4f29-9343-1409eefe5137 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:36.558902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:36.642145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a40838-237e-4f29-9343-1409eefe5137 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:36.676485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:36.677116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.677400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.677675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.678356 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:36.679722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1242ba-ba6a-4bc0-b6ce-899d0a882acb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:36.694652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 646/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:36 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:38.724949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbe012-8046-4dbf-883f-80c2480aa724 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.725502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbe012-8046-4dbf-883f-80c2480aa724 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.725502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbe012-8046-4dbf-883f-80c2480aa724 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.726851 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 650/1296] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:38.732026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.732435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.732637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.750707 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:38.751902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:38.838764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 647/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:38.861522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbe012-8046-4dbf-883f-80c2480aa724 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.960242 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbe012-8046-4dbf-883f-80c2480aa724 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.993478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.994137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.994327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.994599 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.995214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.996595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:39.005208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:39.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:39.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 651/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:39.012421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.029905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.107599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d899b-77c6-4567-84de-8121d83ae0f7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.141447 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.142072 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.142352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.142623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.143302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.143602 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.144988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.151081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 648/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.157198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.189686 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.256525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdac6b-23d0-493d-ae84-4701a9969913 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.289184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.289797 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.290082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.290351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.291097 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] RBAC: Adding query filter params (interface=public, service_id=08071b036bb84ef7894433b983641b3c, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.291403 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.292788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061c8de-82cd-42b1-8c43-b2a9ab2f87b5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.297728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 652/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/endpoints?service_id=08071b036bb84ef7894433b983641b3c&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.303543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.382291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.400747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2238-4883-414d-b380-cc245a3e2ce6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.433650 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.434261 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.434546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.434819 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.435464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.436855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce7976-6d3e-409e-94fb-1551c6649591 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.443445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 649/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:03:41.457654 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa865-6024-4cf3-869f-43ea25e198f7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.458192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa865-6024-4cf3-869f-43ea25e198f7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.458192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa865-6024-4cf3-869f-43ea25e198f7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.459723 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 653/1302] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:41.464763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.465155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.465322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.483643 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:41.484855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:41.549221 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 650/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:41.571877 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fa865-6024-4cf3-869f-43ea25e198f7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:41.665302 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:41.672223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fa865-6024-4cf3-869f-43ea25e198f7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:41.705724 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:41.706365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.706645 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.706922 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.707550 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:41.708998 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:41.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:41.719379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 31 01:03:41.720290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 654/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:41.726335 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:41.805546 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:41.828076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886874fe-9360-4149-8901-0df81c0a87d3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:41.862286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:41.862906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.863192 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.863472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.864149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:41.864494 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:41.865858 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514655e6-0389-481b-bebf-b0b5d67bf29f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:41.870970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 651/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Sun Jul 31 01:03:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:41.876763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:41.978329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10e74-c01d-4943-9675-db3104c6457a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.011161 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.011785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.012070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.012376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.013096 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.014508 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83a04-936c-4d7d-9f84-dfcc22fdf814 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.034072 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 655/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:51.868563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=30 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:52.029950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.694785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75bb9-83db-4036-bcc6-0044f8091e3d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.695847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75bb9-83db-4036-bcc6-0044f8091e3d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.696388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75bb9-83db-4036-bcc6-0044f8091e3d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.701955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 652/1307] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:04:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:45.703439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d5213-0dcd-4ad3-9558-0ed815725436 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.703882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d5213-0dcd-4ad3-9558-0ed815725436 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.703982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d5213-0dcd-4ad3-9558-0ed815725436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.797539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1e5d5213-0dcd-4ad3-9558-0ed815725436 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:45.798975 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1e5d5213-0dcd-4ad3-9558-0ed815725436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:45.942315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 656/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:45.982564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.983008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.983308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.985325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 653/1309] 10.222.0.40 () {54 vars in 965 bytes} [Sun Jul 31 01:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:45.992900 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e8226-ad96-4b82-b7ad-185edfd9f8e0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.993295 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e8226-ad96-4b82-b7ad-185edfd9f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.993750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e8226-ad96-4b82-b7ad-185edfd9f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.137092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6c8e8226-ad96-4b82-b7ad-185edfd9f8e0 None None] MFA Rules not processed for user `9f13b2c9e912492a8e8fb7fec70236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:46.138575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6c8e8226-ad96-4b82-b7ad-185edfd9f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:46.171377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:46.250613 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 657/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Sun Jul 31 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:04:46.251349 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:46.253379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:46.392084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0eb7-cc16-4c43-846c-02c99163fcdd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:46.477867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:46.478553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.478840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.479120 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.481027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:46.545206 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:46.610445 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:46.611922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f9a3-87a2-4110-895f-6e7edac043c4 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:46.635505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 654/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:04:49.028545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8219e-7bed-4f2c-8401-79da1f306dab None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.029090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8219e-7bed-4f2c-8401-79da1f306dab None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.029090 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8219e-7bed-4f2c-8401-79da1f306dab None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.030452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 658/1312] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:49.036154 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb8b9-5dd5-4358-90bf-b546bf4d7f10 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.036608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb8b9-5dd5-4358-90bf-b546bf4d7f10 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.036764 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb8b9-5dd5-4358-90bf-b546bf4d7f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.123604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d7fcb8b9-5dd5-4358-90bf-b546bf4d7f10 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:49.124862 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d7fcb8b9-5dd5-4358-90bf-b546bf4d7f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.226641 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 655/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:49.280297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.280661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.280823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.282152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 659/1314] 10.222.0.40 () {54 vars in 965 bytes} [Sun Jul 31 01:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:49.288564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f246-f2d9-4dff-a75b-8e6f54c7c30b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.288908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f246-f2d9-4dff-a75b-8e6f54c7c30b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.289144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f246-f2d9-4dff-a75b-8e6f54c7c30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.302413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:49.377017 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-40e1f246-f2d9-4dff-a75b-8e6f54c7c30b None None] MFA Rules not processed for user `9f13b2c9e912492a8e8fb7fec70236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:49.378256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40e1f246-f2d9-4dff-a75b-8e6f54c7c30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.459878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 656/1315] 10.222.0.40 () {58 vars in 1062 bytes} [Sun Jul 31 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:49.468956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:49.470490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.574509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7685c8-d0d2-4ce7-9b1f-cf7cb38080ed None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:49.647230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:49.649615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:49.650240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.650776 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.651915 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.653836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.766967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:49.768438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85dc1c-9578-4e7d-8837-bdc7ee57b041 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:49.788866 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 660/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:04:52.852224 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.852799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.852799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.854181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 657/1317] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:52.859586 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2b58-3b28-47ac-b093-52751171ba84 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.860031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2b58-3b28-47ac-b093-52751171ba84 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.860155 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2b58-3b28-47ac-b093-52751171ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.934539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3edb2b58-3b28-47ac-b093-52751171ba84 None None] MFA Rules not processed for user `10f7c295046c4a689020e2c69a3e88df`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:52.935779 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3edb2b58-3b28-47ac-b093-52751171ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:52.986694 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.031802 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 661/1318] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:53.071662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.073267 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:53.176405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288caf4-7531-499f-b97c-a7a79759a429 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.179175 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.254227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.254861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.255148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.255425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.257109 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:53.364954 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.366407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9ce3f-393f-4167-b9c2-748f6a970f09 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.385076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 658/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:04:56.044520 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.045047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.045047 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.046376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 662/1320] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:56.051652 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949188a-fe9d-45a3-8b34-c3921de0a14f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.052039 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949188a-fe9d-45a3-8b34-c3921de0a14f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.052234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949188a-fe9d-45a3-8b34-c3921de0a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.092912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:56.119593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2949188a-fe9d-45a3-8b34-c3921de0a14f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:56.120902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2949188a-fe9d-45a3-8b34-c3921de0a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:56.216435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 659/1321] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:56.255123 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:56.256704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:56.362346 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856c98-344a-4225-97c6-8491a73c4bed None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:56.436366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:56.436994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.437277 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.437554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.439188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:56.447049 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:56.547001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:56.548490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e99357-0e17-4e62-9f65-d6c07514c64a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:56.567758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 663/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:04:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:04:59.268388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.268941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.268941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.270372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 660/1323] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:59.275615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1726-2794-437b-af22-b7cfc357e142 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.276018 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1726-2794-437b-af22-b7cfc357e142 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.276208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1726-2794-437b-af22-b7cfc357e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.343370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-df0c1726-2794-437b-af22-b7cfc357e142 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:59.344631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-df0c1726-2794-437b-af22-b7cfc357e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:59.411543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.458327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 664/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:04:59.496987 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.498528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:59.607418 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01a738-6e77-4c56-9865-7096cf7c37a6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.619611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.681405 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.682044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.682330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.682609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.684542 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:59.798297 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:59.799576 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd448-2bff-4963-b558-2b9af3d27a29 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:59.818941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 661/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:05:01.873633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.874148 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.874148 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.875405 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 665/1326] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:01.880790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e3ed-fed3-454e-ac4d-1b8e4917c3c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.881223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e3ed-fed3-454e-ac4d-1b8e4917c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.881336 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e3ed-fed3-454e-ac4d-1b8e4917c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.939048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.958528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c786e3ed-fed3-454e-ac4d-1b8e4917c3c2 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:01.959761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c786e3ed-fed3-454e-ac4d-1b8e4917c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:02.054832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 662/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:02.091485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.093220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:02.200050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8b14-d66f-4b09-9681-bd0e712e432d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.275549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.276193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.276510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.276786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.278526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:02.298140 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.390360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.391715 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927010cf-5035-4606-be0f-5b426d517096 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.410897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 666/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:04.478136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:04.478693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:04.478693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:04.480039 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 663/1329] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:04.485541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c260d-7c7e-4b16-9141-73a5209254b8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:04.485993 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c260d-7c7e-4b16-9141-73a5209254b8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:04.486219 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c260d-7c7e-4b16-9141-73a5209254b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:04.552041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-816c260d-7c7e-4b16-9141-73a5209254b8 None None] MFA Rules not processed for user `10f7c295046c4a689020e2c69a3e88df`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:04.553271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-816c260d-7c7e-4b16-9141-73a5209254b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:04.617897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:04.651750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 667/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:04.690360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:04.692044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:04.800328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be989-2097-4991-ad78-334cb4c5b06d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:04.819893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:04.872531 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:04.873161 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:04.873451 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:04.873731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:04.875355 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:04.989326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:04.990557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a6084-3e4c-4d36-a9e9-d1440650a34b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:05.010644 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 664/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:07.313010 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.313569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.313569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.314901 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 668/1332] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:07.320785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24a45-f6a1-4bbc-808a-4e0f5b4602ce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.321225 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24a45-f6a1-4bbc-808a-4e0f5b4602ce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.321327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24a45-f6a1-4bbc-808a-4e0f5b4602ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.507156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.510121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-45d24a45-f6a1-4bbc-808a-4e0f5b4602ce None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:07.511929 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-45d24a45-f6a1-4bbc-808a-4e0f5b4602ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:07.609184 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 665/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:07.645704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:07.647441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:07.759663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231cab1-86ed-4279-9898-bba3a871fedd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:07.836179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:07.836829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.837106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.837376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.839147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:07.866109 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.950575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:07.951999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b730-3615-4e4b-ba07-164d520e0c4f service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:07.970237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 669/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:10.029292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.030127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.030127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.031092 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 666/1335] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:10.036806 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1c04-4262-4ad3-b435-9e53faeff452 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.037273 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1c04-4262-4ad3-b435-9e53faeff452 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.037410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1c04-4262-4ad3-b435-9e53faeff452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.112355 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dd1a1c04-4262-4ad3-b435-9e53faeff452 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:10.114100 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dd1a1c04-4262-4ad3-b435-9e53faeff452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:10.189046 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.211535 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 670/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:10.250934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.252518 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:10.366241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc92a1d-48c6-4748-a70d-71099395b93d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.396406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.459902 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.460559 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.460837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.461111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.462741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:10.570833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.572312 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8216d-59d2-4f13-ba41-630cbd6800b5 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.590557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 667/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:13.253929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.254494 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.254494 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.255834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 671/1338] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:13.260951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d371-a6a8-450d-8756-58a619efe358 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.261402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d371-a6a8-450d-8756-58a619efe358 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.261510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d371-a6a8-450d-8756-58a619efe358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.327693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0ff4d371-a6a8-450d-8756-58a619efe358 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:13.328939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0ff4d371-a6a8-450d-8756-58a619efe358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:13.337622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.424599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 668/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:13.461314 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.462890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:13.567642 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de309dbd-2846-45df-bdad-eee530c636c4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.643701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.644898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.645179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.645453 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.647076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:13.682368 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.755887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.757370 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96ad1d-4214-4661-8b2b-2ed4604de122 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.776303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 672/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:17.889111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.889666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.889666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.891009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 669/1341] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:17.898220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753d6e-40cc-4c30-96e1-542f23f0247f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.898792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753d6e-40cc-4c30-96e1-542f23f0247f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.898792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753d6e-40cc-4c30-96e1-542f23f0247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.975206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-85753d6e-40cc-4c30-96e1-542f23f0247f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:17.976469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-85753d6e-40cc-4c30-96e1-542f23f0247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:18.080464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.093992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 673/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:18.133026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.134676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:18.250737 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb196e8-c8b9-4523-b036-632e6e00aaa9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.295384 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.340286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.340920 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.341199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.341473 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.343135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:18.460469 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.462030 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47b81-9ffd-48aa-babf-84f841c1bc4f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.481881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 670/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:21.122644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462dc08-9352-4499-9695-e3365491b834 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.123218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462dc08-9352-4499-9695-e3365491b834 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.123218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462dc08-9352-4499-9695-e3365491b834 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.124758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 674/1344] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:21.131315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839122-c7f6-4ea5-a2c1-b62d3a48e45d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.132604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839122-c7f6-4ea5-a2c1-b62d3a48e45d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1839122-c7f6-4ea5-a2c1-b62d3a48e45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.203855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b1839122-c7f6-4ea5-a2c1-b62d3a48e45d None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:21.205140 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1839122-c7f6-4ea5-a2c1-b62d3a48e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:21.224688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.305777 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 671/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:21.343799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462dc08-9352-4499-9695-e3365491b834 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.345443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0462dc08-9352-4499-9695-e3365491b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:21.449876 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462dc08-9352-4499-9695-e3365491b834 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.524634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.525266 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.525554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.525830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.527471 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:21.571533 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.642490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.644014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04adbc-602b-4a65-be62-ea21d7f6269b service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.663651 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 675/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:25.689326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.689890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.689890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.691468 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 672/1347] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:25.696466 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b23c8-259c-4c9c-b3e0-3adf233f8e6f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.696906 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b23c8-259c-4c9c-b3e0-3adf233f8e6f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.697053 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b23c8-259c-4c9c-b3e0-3adf233f8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.787563 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c29b23c8-259c-4c9c-b3e0-3adf233f8e6f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:25.789020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c29b23c8-259c-4c9c-b3e0-3adf233f8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:25.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.930873 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 676/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:25.975844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.977446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:26.089686 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db805d-4c69-4a09-84d1-f1416a309d37 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.144337 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.171921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.172591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.172881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.173155 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.174802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:26.303471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.305093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4568ec-860e-4f54-ad23-05a4992a328a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.325609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 673/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:31.232056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec833d-1aae-49a4-a61b-29caaa255e0d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.232509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec833d-1aae-49a4-a61b-29caaa255e0d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.233009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec833d-1aae-49a4-a61b-29caaa255e0d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.234287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 677/1350] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:31.240327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f629a-2d5d-48cd-bc27-1e818bf8dc4e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.241114 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f629a-2d5d-48cd-bc27-1e818bf8dc4e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.241547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f629a-2d5d-48cd-bc27-1e818bf8dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.367150 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eb1f629a-2d5d-48cd-bc27-1e818bf8dc4e None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:31.368573 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eb1f629a-2d5d-48cd-bc27-1e818bf8dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:31.405066 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.511302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 674/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:35.687181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb8ec-a429-4d43-b55e-3a0dbaaaf699 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.688196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb8ec-a429-4d43-b55e-3a0dbaaaf699 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.688662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bb8ec-a429-4d43-b55e-3a0dbaaaf699 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.690311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 678/1352] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:35.695569 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b409f-9e2e-4e37-b5cc-6d664fa76dcc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.696001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b409f-9e2e-4e37-b5cc-6d664fa76dcc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.696199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b409f-9e2e-4e37-b5cc-6d664fa76dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.781915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d26b409f-9e2e-4e37-b5cc-6d664fa76dcc None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:35.783460 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d26b409f-9e2e-4e37-b5cc-6d664fa76dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:35.865007 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.913761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 675/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:37.096976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b21-0292-4ac7-99ea-d9d75d55d28f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.097584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b21-0292-4ac7-99ea-d9d75d55d28f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.097684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b21-0292-4ac7-99ea-d9d75d55d28f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.099131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 679/1354] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:37.104273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6b8e-dd52-40f2-9595-95e41fc8811c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.104709 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6b8e-dd52-40f2-9595-95e41fc8811c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.105038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6b8e-dd52-40f2-9595-95e41fc8811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.186570 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4d3d6b8e-dd52-40f2-9595-95e41fc8811c None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:37.187805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4d3d6b8e-dd52-40f2-9595-95e41fc8811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:37.293750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 676/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:40.928439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f692d-e595-46a6-8717-f3b93f88deb1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.929413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f692d-e595-46a6-8717-f3b93f88deb1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.929909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f692d-e595-46a6-8717-f3b93f88deb1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.936203 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 680/1356] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:40.937953 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b2b-f8b1-4ac4-b3c9-10be47a85591 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b2b-f8b1-4ac4-b3c9-10be47a85591 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.939328 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b2b-f8b1-4ac4-b3c9-10be47a85591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.982813 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.019657 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-15b25b2b-f8b1-4ac4-b3c9-10be47a85591 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:41.021180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-15b25b2b-f8b1-4ac4-b3c9-10be47a85591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:41.129367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 677/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:41.197605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.198429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.199227 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.201199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 681/1358] 10.222.0.40 () {54 vars in 962 bytes} [Sun Jul 31 01:05:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:41.211862 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b8dd-88ab-4b70-8c2d-c340eda31fdc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.212223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b8dd-88ab-4b70-8c2d-c340eda31fdc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.212481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b8dd-88ab-4b70-8c2d-c340eda31fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.297247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7170b8dd-88ab-4b70-8c2d-c340eda31fdc None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:41.298466 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7170b8dd-88ab-4b70-8c2d-c340eda31fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:41.352795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.432391 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 678/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Jul 31 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:41.438409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.440480 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:41.629788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd61b1-87ca-4fe8-8974-213dda5f8571 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.708538 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.757382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.758006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.758288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.758561 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.760164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:41.865882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8fe83-485c-4fc6-a1a7-f6c94d7e284a service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.898817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 682/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:44.151009 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.151516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.151611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.153094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 679/1361] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:44.158258 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968250d-3753-4ccf-ae8f-211e044dee6c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.159070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968250d-3753-4ccf-ae8f-211e044dee6c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.159352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968250d-3753-4ccf-ae8f-211e044dee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.230315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3968250d-3753-4ccf-ae8f-211e044dee6c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:44.232201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3968250d-3753-4ccf-ae8f-211e044dee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:44.279927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.365919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 683/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:44.410600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.412329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:44.595311 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e919ff-e03e-414b-a6f5-177da71b3092 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.608218 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.730617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.731745 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.732214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.732738 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.734770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:44.830956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.832493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5f7e9-1dda-456e-90d1-3765ea98c555 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.851921 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 680/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:47.202948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d25-d45b-42ca-a024-d37551ad9435 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.203461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d25-d45b-42ca-a024-d37551ad9435 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.203543 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1d25-d45b-42ca-a024-d37551ad9435 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.205114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 684/1364] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:47.210347 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4a76-d3de-4433-a985-9f19bd1ba403 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.210797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4a76-d3de-4433-a985-9f19bd1ba403 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.210888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4a76-d3de-4433-a985-9f19bd1ba403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.229135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.294126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3f1a4a76-d3de-4433-a985-9f19bd1ba403 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:47.295367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3f1a4a76-d3de-4433-a985-9f19bd1ba403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:47.401895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 681/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:47.448244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.448904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.449305 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.450747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 685/1366] 10.222.0.40 () {54 vars in 962 bytes} [Sun Jul 31 01:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:47.456720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac297cf-f291-4b67-8743-4159a7c79f89 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.457015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac297cf-f291-4b67-8743-4159a7c79f89 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.457300 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac297cf-f291-4b67-8743-4159a7c79f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.553861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-aac297cf-f291-4b67-8743-4159a7c79f89 None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:47.555479 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aac297cf-f291-4b67-8743-4159a7c79f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:47.611446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.713816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 682/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Jul 31 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:47.724574 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.726288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:47.942704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973367-798e-42f2-897c-3d4fb862dc0d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.967706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:48.086800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.087429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.087714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.087988 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.089661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:48.203332 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.205030 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3214-4543-4dbd-8246-f690ded2ed71 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.225398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 686/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:49.117647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e96-ab2c-438a-87fe-67705a2420ae None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.118194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e96-ab2c-438a-87fe-67705a2420ae None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.118194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e96-ab2c-438a-87fe-67705a2420ae None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.119802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 683/1369] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:49.124828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b929da-78e2-461c-af5d-d511ad4610e9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.125124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b929da-78e2-461c-af5d-d511ad4610e9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.125404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b929da-78e2-461c-af5d-d511ad4610e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.161641 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.199505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0b929da-78e2-461c-af5d-d511ad4610e9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:49.200768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0b929da-78e2-461c-af5d-d511ad4610e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:49.303498 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 687/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:49.649315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.649603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.649882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.651385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 684/1371] 10.222.0.40 () {54 vars in 964 bytes} [Sun Jul 31 01:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:49.656281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406e6c-5c95-4d9e-9ac5-9cc5959343da None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.656570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406e6c-5c95-4d9e-9ac5-9cc5959343da None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.656845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406e6c-5c95-4d9e-9ac5-9cc5959343da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.737612 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f5406e6c-5c95-4d9e-9ac5-9cc5959343da None None] MFA Rules not processed for user `1064e968daa5452983255aeec2883691`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:49.739162 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f5406e6c-5c95-4d9e-9ac5-9cc5959343da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:49.787944 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.818743 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 688/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Sun Jul 31 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:49.826616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.828358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:49.940574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95c28-c5e1-4783-ae69-3d67fcdd190b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.982359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.018489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1064e968daa5452983255aeec2883691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.019712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.020105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.020499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.022234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:50.150887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.152234 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a8016-ce8f-4024-9c02-221b1bad87a9 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.174508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 685/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:50.314152 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.315297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.315297 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.316803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 689/1374] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:50.321811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d094f2-7565-4a8e-8ecb-8570d85365ab None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.322111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d094f2-7565-4a8e-8ecb-8570d85365ab None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.322424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d094f2-7565-4a8e-8ecb-8570d85365ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.402424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e7d094f2-7565-4a8e-8ecb-8570d85365ab None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:50.403741 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e7d094f2-7565-4a8e-8ecb-8570d85365ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:50.425388 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.505480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 686/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:50.550126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.553880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:50.714037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77f4e8-81c8-40d9-b45d-24691f212c3b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.766740 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.840433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.841082 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.841369 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.841659 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.843433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:50.951130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.953081 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5725088-a313-4f19-a55f-d514a7515d29 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.974487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 690/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:53.038795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.039309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.039404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.040759 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 687/1377] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:53.045942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35632-259f-414e-a1ce-a1bc01aadd0e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.046393 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35632-259f-414e-a1ce-a1bc01aadd0e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.046625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35632-259f-414e-a1ce-a1bc01aadd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.121515 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0f35632-259f-414e-a1ce-a1bc01aadd0e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:53.122862 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0f35632-259f-414e-a1ce-a1bc01aadd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:53.130154 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.248824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 691/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:05:53.293770 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.295215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:53.449171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61634-c2cd-4e4e-aece-e1f4226e38e3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.452755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.581077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.581925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.582482 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.582839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.584710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:53.709219 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.711174 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc77717-5279-4859-a8f3-a2a20500ebc8 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.733925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 688/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:55.838838 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.839386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.839386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.841750 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 692/1380] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:55.848145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05143343-6ae9-423e-907a-4d927554553f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.848698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05143343-6ae9-423e-907a-4d927554553f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.849165 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05143343-6ae9-423e-907a-4d927554553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.861434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.925475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-05143343-6ae9-423e-907a-4d927554553f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:55.926837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-05143343-6ae9-423e-907a-4d927554553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:56.040702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 689/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:56.081687 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.083238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:56.240328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.254568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be146d-5676-4dd2-ba8a-ec0cfe5e4841 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.378533 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.379720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.380010 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.380316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.382000 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:56.479947 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.481597 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641beeb-be3f-4627-a9c4-1d9b24a3e6eb service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.492610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.501766 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 693/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:05:58.651137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30077589-79bf-4649-b896-31eefcce9621 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.651678 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30077589-79bf-4649-b896-31eefcce9621 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.652086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30077589-79bf-4649-b896-31eefcce9621 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.654372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 690/1383] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:58.659845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0669-a3a9-476f-8d5d-bb92f7516a37 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.660342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0669-a3a9-476f-8d5d-bb92f7516a37 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.660452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0669-a3a9-476f-8d5d-bb92f7516a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.732549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8c8e0669-a3a9-476f-8d5d-bb92f7516a37 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:58.733829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8c8e0669-a3a9-476f-8d5d-bb92f7516a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:58.839012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 694/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:05:58.898528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30077589-79bf-4649-b896-31eefcce9621 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.900093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-30077589-79bf-4649-b896-31eefcce9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:58.991417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.072467 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30077589-79bf-4649-b896-31eefcce9621 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.251590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.252855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.253593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.254258 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.257159 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:59.319948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.364712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.366351 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090033-4b74-4490-ac26-f23dc5acf03d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.386608 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 691/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:01.538640 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.539510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.539510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.569178 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 695/1386] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:01.569309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e96bd-be35-404f-8e4d-7c328ccffcf0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.569309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e96bd-be35-404f-8e4d-7c328ccffcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.569309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e96bd-be35-404f-8e4d-7c328ccffcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.627567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6e7e96bd-be35-404f-8e4d-7c328ccffcf0 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:01.628810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6e7e96bd-be35-404f-8e4d-7c328ccffcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:01.737000 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 692/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:06:01.781813 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.783413 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:01.865240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.945608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6b73-ff83-4d95-a22b-75e85e35eaa0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.063121 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.063781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.064697 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.066664 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:02.119079 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.175455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.177569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e916-6756-4076-b352-a6e93e9d78f1 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.200948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 696/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:04.380183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.380763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.380763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.382139 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 693/1389] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:04.387575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e19-8948-4124-b350-6efdc735f539 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.388031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e19-8948-4124-b350-6efdc735f539 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.388124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e19-8948-4124-b350-6efdc735f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.457551 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-80468e19-8948-4124-b350-6efdc735f539 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:04.458770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-80468e19-8948-4124-b350-6efdc735f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:04.554799 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 697/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:06:04.599799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.601385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:04.632414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.747010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2963aa0-edd8-47bd-8171-8d651479eaa1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.849791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.863042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.863676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.863961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.864238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.865896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:04.958527 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.960136 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa2820-192c-4e64-924f-aebca2ea5d08 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.978269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 694/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:06:05.336533 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed1ba-00b1-43b5-8515-01503abb46cf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.336788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed1ba-00b1-43b5-8515-01503abb46cf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.337069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed1ba-00b1-43b5-8515-01503abb46cf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 698/1392] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:05.343802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a63b-ab81-4c6e-a144-450a927cb931 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.344127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a63b-ab81-4c6e-a144-450a927cb931 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.344437 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a63b-ab81-4c6e-a144-450a927cb931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.411490 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b754a63b-ab81-4c6e-a144-450a927cb931 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:05.412795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b754a63b-ab81-4c6e-a144-450a927cb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:05.472024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.541533 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 695/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:05.597793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.598275 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.598492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.599907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 699/1394] 10.222.0.40 () {54 vars in 966 bytes} [Sun Jul 31 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:05.605259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105359f-c485-44b4-a70e-5832f02ae3fe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.605623 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105359f-c485-44b4-a70e-5832f02ae3fe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.605971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105359f-c485-44b4-a70e-5832f02ae3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.682971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6105359f-c485-44b4-a70e-5832f02ae3fe None None] MFA Rules not processed for user `1c0d2b6058dd4609aef49555bb568453`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:05.684598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6105359f-c485-44b4-a70e-5832f02ae3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:05.762013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 696/1395] 10.222.0.40 () {58 vars in 1063 bytes} [Sun Jul 31 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:05.770135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:05.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.883462 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3cfa-1f6c-4f25-a399-dcbcedbcf04c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.958763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0d2b6058dd4609aef49555bb568453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.959393 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.959676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.959949 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.961609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:06.030237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:06.074400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:06.075887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a37fa-6627-43cb-bb62-d13abb1c22d7 service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:06.094063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 700/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:06.829867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c112-a878-42a7-8bd9-af75eccd2660 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:06.830417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c112-a878-42a7-8bd9-af75eccd2660 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:06.830528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c112-a878-42a7-8bd9-af75eccd2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:06.897395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6064c112-a878-42a7-8bd9-af75eccd2660 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:06.898624 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6064c112-a878-42a7-8bd9-af75eccd2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:06.907027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:06.990315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 697/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:07.042250 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19fca6-5b93-4f6b-bcd7-1af26510392a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.042777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19fca6-5b93-4f6b-bcd7-1af26510392a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.042777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19fca6-5b93-4f6b-bcd7-1af26510392a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.044634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 701/1398] 10.222.0.40 () {54 vars in 943 bytes} [Sun Jul 31 01:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:07.051077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.051374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.051651 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.059418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2d062-dc3e-4ab7-85d8-c68a99d0425a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.059709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2d062-dc3e-4ab7-85d8-c68a99d0425a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.059990 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2d062-dc3e-4ab7-85d8-c68a99d0425a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.061357 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 702/1399] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:07.066360 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.066678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.066959 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.137690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] MFA Rules not processed for user `4fa95647578f48108da5f532c53ae3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:07.138662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:07.138965 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.139858 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.239520 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.257562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 703/1400] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:06:07.264305 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 698/1401] 10.222.0.40 () {58 vars in 1040 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:07.273842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.275107 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.301934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.302134 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.303196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.383824 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b259-a7ad-49a7-ab68-3ffa859ef6c4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.402915 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691487-2519-4b6c-9ee7-9fc90dbb7168 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.488321 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.488942 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.489221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.489490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.491136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.511095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.518695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.519324 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.519612 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.519890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.521552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.531340 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.576449 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.578830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733724-4966-48da-838b-bc67cbead87f service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.587522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 704/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:07.617197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.618906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a822f14-5d8f-4e20-b24c-aae798073e9f service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.637563 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 699/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:06:09.716094 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.716664 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.716664 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.718026 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 705/1404] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:09.724054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5447f-8003-49c2-8419-7fec35918f88 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.724601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5447f-8003-49c2-8419-7fec35918f88 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.724685 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5447f-8003-49c2-8419-7fec35918f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.804006 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-30b5447f-8003-49c2-8419-7fec35918f88 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:09.805263 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-30b5447f-8003-49c2-8419-7fec35918f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:09.871314 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:09.914647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 700/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:06:09.961340 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.962881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:10.139225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a9b32-4897-4792-8c3b-4a673e05543b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.183485 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.270773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.271408 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.271821 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.273759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.275103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:10.380028 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.381685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fe799-d1ce-421f-8da0-902ab604b253 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.410158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 706/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:12.608108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.608749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.608749 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.610077 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 701/1407] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:12.615683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a073-d0ec-447c-a0ce-e113da9e94eb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.616130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a073-d0ec-447c-a0ce-e113da9e94eb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.616235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a073-d0ec-447c-a0ce-e113da9e94eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.676036 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.712516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dd13a073-d0ec-447c-a0ce-e113da9e94eb None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:12.713951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dd13a073-d0ec-447c-a0ce-e113da9e94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:12.827067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 707/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:12.874022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.876078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:13.075205 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33670b-d06a-4eb4-9b13-b0d2aa17f158 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.137811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.209203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.209951 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.210241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.210521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.212178 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:13.310054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.311675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffec5b-e6b6-471e-bda0-bfeccad4214b service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.332379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 702/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:22.825548 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=47 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:23.329705 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=75 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:29.960973 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6601b-ad52-4386-b369-6b2b811957b5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:29.961513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6601b-ad52-4386-b369-6b2b811957b5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:29.961513 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6601b-ad52-4386-b369-6b2b811957b5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:29.962869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 708/1410] 10.222.0.40 () {54 vars in 918 bytes} [Sun Jul 31 01:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:29.967995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354f1e-7f5d-4647-9617-0e0756e008bf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:29.968484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354f1e-7f5d-4647-9617-0e0756e008bf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:29.968673 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354f1e-7f5d-4647-9617-0e0756e008bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.046208 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-55354f1e-7f5d-4647-9617-0e0756e008bf None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:30.047343 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-55354f1e-7f5d-4647-9617-0e0756e008bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:30.158254 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 703/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Jul 31 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:30.173172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c492-6201-41ac-b918-7a6ed899dbc5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.173462 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c492-6201-41ac-b918-7a6ed899dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.173741 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8c492-6201-41ac-b918-7a6ed899dbc5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.175075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 709/1412] 10.222.0.40 () {54 vars in 918 bytes} [Sun Jul 31 01:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:30.179667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379b26-628a-4637-96e0-b67acff242a7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.179957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379b26-628a-4637-96e0-b67acff242a7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.180236 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379b26-628a-4637-96e0-b67acff242a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.252867 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.255535 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-57379b26-628a-4637-96e0-b67acff242a7 None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:30.257361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-57379b26-628a-4637-96e0-b67acff242a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:30.372875 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 704/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Sun Jul 31 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:32.830078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:32.830649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:32.830649 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:32.831954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:32.837172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb6ac-8ef4-414a-91f0-45b3807d84b9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:32.837584 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb6ac-8ef4-414a-91f0-45b3807d84b9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:32.837725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb6ac-8ef4-414a-91f0-45b3807d84b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:32.907374 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4bedb6ac-8ef4-414a-91f0-45b3807d84b9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:32.908693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4bedb6ac-8ef4-414a-91f0-45b3807d84b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:32.964080 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.005820 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:33.049491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:33.051666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:33.196881 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5eec-0c91-4671-9b92-4d9f680d70cb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:33.270773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.313369 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:33.313996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:33.314282 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:33.314559 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:33.316189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:33.404377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:33.405929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87cdb-205c-4bd7-80fa-813afbca9773 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:33.424070 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 711/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:34.326821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:34.327407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:34.327508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:34.329063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:34.334455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e27-f1de-49c9-b734-3064e5bdb553 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:34.334889 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e27-f1de-49c9-b734-3064e5bdb553 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:34.335006 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e27-f1de-49c9-b734-3064e5bdb553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:34.411547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7bf09e27-f1de-49c9-b734-3064e5bdb553 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:34.412708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7bf09e27-f1de-49c9-b734-3064e5bdb553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:34.440390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:34.509572 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:34.666327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:34.667784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:34.811024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c4df-2343-4e15-9b45-6e4cb9333e4d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:34.851980 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:34.929934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:34.930557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:34.930837 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:34.931111 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:34.933029 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:35.020432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:35.022046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad98738-c882-42c8-af43-53c56958b899 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:35.039812 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 707/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:06:35.925312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.925885 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.925885 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.927193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:35.932193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7bac8-aae7-4462-a976-92e2168232c6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.932887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7bac8-aae7-4462-a976-92e2168232c6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.933027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7bac8-aae7-4462-a976-92e2168232c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.987167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:36.008698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-22f7bac8-aae7-4462-a976-92e2168232c6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:36.009919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-22f7bac8-aae7-4462-a976-92e2168232c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:36.105956 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:36.273887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:36.276847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:36.490202 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48015a-2d2c-443a-9d5f-a53b88a068ee None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:36.502205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:36.611582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:36.612222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:36.612539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:36.612841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:36.614532 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:36.706196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:36.707822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfddf3-3213-449b-822c-c2c35ae0071f service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:36.726114 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 714/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:37.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:37.611243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:37.611243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:37.612627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:37.617486 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975bbe-2895-4528-9662-a4e382296f58 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:37.617912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975bbe-2895-4528-9662-a4e382296f58 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:37.618059 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f975bbe-2895-4528-9662-a4e382296f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:37.638035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:37.697527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4f975bbe-2895-4528-9662-a4e382296f58 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:37.699302 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4f975bbe-2895-4528-9662-a4e382296f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:37.811880 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:37.960874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:37.963149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:38.085138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.122361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b82d1-d5a5-4722-8455-06193eaded79 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.234504 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.235040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.235329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.235600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.237244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:38.310838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.325372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:38.326990 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df517-45eb-4e8e-ab23-d7831fd78b89 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:38.346477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 710/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:39.210899 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:39.211738 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:39.211926 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:39.213463 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:39.218640 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50eaa4-8555-49a7-9048-775df9b0c361 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:39.219073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50eaa4-8555-49a7-9048-775df9b0c361 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:39.219186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50eaa4-8555-49a7-9048-775df9b0c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:39.318471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bb50eaa4-8555-49a7-9048-775df9b0c361 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:39.319729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bb50eaa4-8555-49a7-9048-775df9b0c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:39.426663 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:39.580481 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:39.582076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:39.670089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:39.740105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542e6c-1e2f-4fb2-a89e-a3aa193ef889 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:39.857934 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:39.859144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:39.859427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:39.859705 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:39.861394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:39.916829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:39.966708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:39.968902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b655b64-2c3a-4455-b8b5-812078c4fe65 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:39.995884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 717/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:40.868170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:40.868794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:40.868794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:40.870149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:40.875843 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da426-0667-43e2-9188-8825415a4164 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:40.876316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da426-0667-43e2-9188-8825415a4164 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:40.876436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da426-0667-43e2-9188-8825415a4164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:40.955244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4f8da426-0667-43e2-9188-8825415a4164 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:40.956494 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4f8da426-0667-43e2-9188-8825415a4164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:41.080066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:41.240898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.242434 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:41.291905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.394718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492fe64-e639-4db3-ade3-4cccf655f975 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.514754 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.515515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.515842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.516191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.518022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:41.525191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.618090 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:41.619815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca257eb-2e3c-4d60-b62d-04207c8b1fea service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:41.641363 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 713/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:42.486703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:42.487315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:42.487315 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:42.488675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:42.493610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12134-0657-4ef2-8f7f-a1d69cbeacf2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:42.494059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12134-0657-4ef2-8f7f-a1d69cbeacf2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:42.494163 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12134-0657-4ef2-8f7f-a1d69cbeacf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:42.578084 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-28d12134-0657-4ef2-8f7f-a1d69cbeacf2 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:42.580086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-28d12134-0657-4ef2-8f7f-a1d69cbeacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:42.660898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:42.693636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:42.852888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:42.854301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:42.871683 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:43.001552 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eba6e-71f0-43de-a4a5-28feb1250098 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:43.089819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:43.125669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:43.126215 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:43.126499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:43.126888 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:43.128582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:43.217253 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:43.218887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea97d1-e379-4178-909d-69b737716a4b service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:43.237308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 720/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:44.051290 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.051832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.051832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.054795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:44.058832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5f30-b28f-4a10-af93-a04fe8986f7a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.059292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5f30-b28f-4a10-af93-a04fe8986f7a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.059394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5f30-b28f-4a10-af93-a04fe8986f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.145935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-648a5f30-b28f-4a10-af93-a04fe8986f7a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:44.147172 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-648a5f30-b28f-4a10-af93-a04fe8986f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:44.189092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.242961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:44.403833 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.405342 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:44.575359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e41ce-d7ad-4ea7-9a8d-83062310d7a8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.630308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.694435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.695484 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.695780 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.696063 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.697751 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:44.793100 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.794726 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446a693-f452-4eca-905c-fd88b6c784f5 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:44.815033 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 716/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:45.622376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:45.622961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:45.622961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:45.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:45.629582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfbb7-2f09-499f-a22b-c2fc009e033e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:45.629996 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfbb7-2f09-499f-a22b-c2fc009e033e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:45.630143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfbb7-2f09-499f-a22b-c2fc009e033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:45.710446 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4f2dfbb7-2f09-499f-a22b-c2fc009e033e None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:45.711683 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f2dfbb7-2f09-499f-a22b-c2fc009e033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:45.713746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:45.811803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:45.962770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:45.964339 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:46.113300 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb7f5-cc0e-42fb-ae3e-734f869a3524 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:46.141384 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:46.228885 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:46.229437 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:46.229720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:46.229992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:46.231637 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:46.320182 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:46.321815 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c9ee2-b08f-4605-b95d-b99e9c4c4423 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:46.340271 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 723/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:48.255715 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:48.256325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:48.256325 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:48.257653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:48.262845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cdfc-6b54-452b-af8e-324fbb00919c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:48.263260 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cdfc-6b54-452b-af8e-324fbb00919c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:48.263412 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cdfc-6b54-452b-af8e-324fbb00919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:48.304736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:48.330509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f748cdfc-6b54-452b-af8e-324fbb00919c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:48.331731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f748cdfc-6b54-452b-af8e-324fbb00919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:48.429056 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:48.469411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:48.470864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:48.574617 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3a1db-2c8b-4245-a523-1886cfd6f5fc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:48.606577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:48.649755 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:48.650385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:48.650667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:48.650942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:48.652590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:48.759940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:48.761411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e02d87-b0b6-47b1-99a1-36c3bb852423 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:48.780735 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 719/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:50.954443 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:50.955009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:50.955009 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:50.956527 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:50.961528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6994837-2a49-4d6c-ab6e-917fbe3f4b0b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:50.961941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6994837-2a49-4d6c-ab6e-917fbe3f4b0b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:50.962087 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6994837-2a49-4d6c-ab6e-917fbe3f4b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:51.027818 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e6994837-2a49-4d6c-ab6e-917fbe3f4b0b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:51.029123 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e6994837-2a49-4d6c-ab6e-917fbe3f4b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:51.042436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:51.128306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:51.166816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:51.168415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:51.273954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b112d-dc85-46d9-9390-e5693b8a3f11 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:51.286539 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:51.348483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:51.349116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:51.349401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:51.349676 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:51.351316 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:51.461768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:51.463468 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae514-7cff-4269-93ed-b1160eb633ce service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:51.482668 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 726/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:54.366832 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.367372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.367372 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.368791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:54.374088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00692-9ab0-431f-85e9-96b4902bec0c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.374564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00692-9ab0-431f-85e9-96b4902bec0c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.374677 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00692-9ab0-431f-85e9-96b4902bec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.423859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:54.443390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c9c00692-9ab0-431f-85e9-96b4902bec0c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:54.444673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c9c00692-9ab0-431f-85e9-96b4902bec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:54.546809 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:54.587855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:54.589503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:54.703750 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8643f09-f1ff-40b4-9396-9489867aa9e5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:54.748515 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:54.789471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:54.790100 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.790399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.790907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.793001 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:54.909015 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:54.910492 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73164e5-7f5e-4150-bc5c-29259ebc914b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:54.928307 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 722/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:57.137971 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.138394 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.138525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.139863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:57.145273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47084-bd17-4f11-bf3b-60ab8e8f6259 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.145669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47084-bd17-4f11-bf3b-60ab8e8f6259 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.145838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47084-bd17-4f11-bf3b-60ab8e8f6259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.212223 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f4c47084-bd17-4f11-bf3b-60ab8e8f6259 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:57.213495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f4c47084-bd17-4f11-bf3b-60ab8e8f6259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:57.236591 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.315886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:06:57.354823 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.356429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:57.458810 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a03d-cba8-472f-a3ae-471750efb833 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.478364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.531493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.532103 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.532411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.532689 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.534296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:57.644744 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:57.646190 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a512c1-8dc4-4988-a08b-e8af5f079207 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:57.664349 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 729/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:59.879695 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:59.880320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:59.880320 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:59.881647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:59.887005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f33-d6ad-4982-85fa-092d95e71bed None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:59.887504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f33-d6ad-4982-85fa-092d95e71bed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:59.887621 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7f33-d6ad-4982-85fa-092d95e71bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:59.954863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:59.957848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-960b7f33-d6ad-4982-85fa-092d95e71bed None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:59.959704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-960b7f33-d6ad-4982-85fa-092d95e71bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:00.062138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:00.099509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.101089 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:00.211900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af261-951c-48fb-bc33-f10ac0312a69 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.273936 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:00.301308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.301934 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.302214 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.302486 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.304106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:00.411629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:00.412997 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3e6bc-0e61-40d6-a081-fc7651efacb2 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:00.432270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 725/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:02.551093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:02.551662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:02.551662 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:02.553088 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:02.558619 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77166-6fb5-4608-8a37-df064ca21d2a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:02.559076 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77166-6fb5-4608-8a37-df064ca21d2a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:02.559181 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77166-6fb5-4608-8a37-df064ca21d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:02.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1ce77166-6fb5-4608-8a37-df064ca21d2a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:02.625344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1ce77166-6fb5-4608-8a37-df064ca21d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:02.655626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:02.723984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:02.762566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:02.764131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:02.867728 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9161a-1123-4aa4-a333-0883d3ad331b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:02.900940 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:02.949164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:02.949833 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:02.950092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:02.950382 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:02.952197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:03.061490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:03.062933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440d642-e6b0-4c65-b204-ebd01ffd4150 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:03.081037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 732/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:05.132032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:05.132622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:05.132622 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:05.134059 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:05.140385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f687-3998-4c0d-b477-09836f5cb5aa None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:05.140859 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f687-3998-4c0d-b477-09836f5cb5aa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:05.140956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f687-3998-4c0d-b477-09836f5cb5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:05.207138 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-25a9f687-3998-4c0d-b477-09836f5cb5aa None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:05.208386 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-25a9f687-3998-4c0d-b477-09836f5cb5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:05.216930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:05.304450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:05.343028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:05.344625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:05.446878 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8bcb-7d11-43b8-92b0-a221a9f7f957 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:05.501948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:05.520302 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:05.520926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:05.521203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:05.521477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:05.523086 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:05.630836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:05.632296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022d71c-2d54-45da-8dae-d21c8f8e71a5 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:05.650900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 728/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:07.711228 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:07.711796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:07.711796 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:07.713183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:07.718907 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fccff5-6b14-4d06-98c1-3137bfdee663 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:07.719327 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fccff5-6b14-4d06-98c1-3137bfdee663 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:07.719455 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fccff5-6b14-4d06-98c1-3137bfdee663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:07.788191 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-44fccff5-6b14-4d06-98c1-3137bfdee663 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:07.789471 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-44fccff5-6b14-4d06-98c1-3137bfdee663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:07.828266 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:07.889056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:07.926872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:07.928473 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:08.035039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c576f-dcb9-45d4-8d24-09bad4629f10 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:08.071361 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:08.107907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:08.108567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:08.108861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:08.109137 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:08.110846 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:08.220285 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:08.221727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451589-34c6-4069-8835-43e679a89cce service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:08.239680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 735/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:10.284046 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:10.284625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:10.284625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:10.286020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:10.291619 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51eb4b-6111-47f5-aee5-652bcef4f5e7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:10.292048 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51eb4b-6111-47f5-aee5-652bcef4f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:10.292173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51eb4b-6111-47f5-aee5-652bcef4f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:10.359200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9d51eb4b-6111-47f5-aee5-652bcef4f5e7 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:10.360465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d51eb4b-6111-47f5-aee5-652bcef4f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:10.378308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:10.456585 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:10.494230 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:10.495768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:10.598309 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e551b-9e44-4e65-96f3-053861d46e71 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:10.665131 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:10.673462 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:10.674100 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:10.674385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:10.674666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:10.676368 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:10.784196 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:10.785603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09fc2-af56-421c-a5e5-511e77e2b0ee service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:10.803666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 731/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:12.862511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:12.863115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:12.863115 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:12.864492 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:12.870069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699773-305e-451d-83be-90a9052142e8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:12.870490 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699773-305e-451d-83be-90a9052142e8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:12.870628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699773-305e-451d-83be-90a9052142e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:12.938773 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c2699773-305e-451d-83be-90a9052142e8 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:12.939999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c2699773-305e-451d-83be-90a9052142e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:12.988784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:13.041628 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:13.079522 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:13.081126 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:13.186923 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb69482-4c99-4dfc-8ca9-2ae2d1a593ce None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:13.233652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:13.259119 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:13.259731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:13.260011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:13.260308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:13.261922 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:13.369110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:13.370544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d5ba8-2ceb-4a30-a955-6de0f372463e service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:13.388383 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 738/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:23.039767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=22 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:23.386218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=66 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:33.128220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd005170-2775-462f-b99e-4dfd6b4a1c06 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:33.128220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd005170-2775-462f-b99e-4dfd6b4a1c06 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:33.129093 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd005170-2775-462f-b99e-4dfd6b4a1c06 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:33.129900 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 733/1471] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:33.135274 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6facc-6b4b-4299-b120-9bba4bca9c98 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:33.135763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6facc-6b4b-4299-b120-9bba4bca9c98 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:33.135883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6facc-6b4b-4299-b120-9bba4bca9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:33.201453 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-24c6facc-6b4b-4299-b120-9bba4bca9c98 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:33.202673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-24c6facc-6b4b-4299-b120-9bba4bca9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:33.301105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 739/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:33.385454 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:33.385778 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:33.386587 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:33.387958 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 734/1473] 10.222.0.40 () {54 vars in 966 bytes} [Sun Jul 31 01:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:33.392978 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c07dd-fc01-45f9-9010-c570221da2ee None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:33.393270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c07dd-fc01-45f9-9010-c570221da2ee None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:33.393669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c07dd-fc01-45f9-9010-c570221da2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:33.469181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-959c07dd-fc01-45f9-9010-c570221da2ee None None] MFA Rules not processed for user `1c0d2b6058dd4609aef49555bb568453`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:33.470429 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-959c07dd-fc01-45f9-9010-c570221da2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:33.490617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:33.547969 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 740/1474] 10.222.0.40 () {58 vars in 1063 bytes} [Sun Jul 31 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:33.555629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:33.557429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:33.660244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e7bcb-16a1-4ff2-8c80-cd17543f9b03 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:33.737119 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0d2b6058dd4609aef49555bb568453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:33.737739 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:33.738019 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:33.738289 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:33.739893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:33.794008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:33.850179 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:33.851662 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b382be5-e647-4301-9164-f12970be6c2b service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:33.869886 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 735/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:07:35.961633 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:35.962193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:35.962193 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:35.963536 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 741/1476] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:35.968814 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaaa1-d54d-4312-8bee-18baf5f0265f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:35.969249 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaaa1-d54d-4312-8bee-18baf5f0265f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:35.969379 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaaa1-d54d-4312-8bee-18baf5f0265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:36.034611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5facaaa1-d54d-4312-8bee-18baf5f0265f None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:36.035827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5facaaa1-d54d-4312-8bee-18baf5f0265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:36.133032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 736/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:36.156130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:36.157708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:36.281547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4e844-74a5-4117-bd14-ac2d5b34af47 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:36.330226 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:36.375763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:36.376417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:36.376698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:36.376970 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:36.377671 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:36.379438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:36.379438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:07:36.379438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:07:36.380628 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b8af6-ff48-495a-8a91-5b3b42405bfc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:36.400313 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 742/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Sun Jul 31 01:07:36 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:07:38.437918 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:38.438493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:38.438493 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:38.439822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 737/1479] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:38.444984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263e4a-2311-4cb1-9763-2517765cbd15 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:38.445476 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263e4a-2311-4cb1-9763-2517765cbd15 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:38.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263e4a-2311-4cb1-9763-2517765cbd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:38.511620 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-09263e4a-2311-4cb1-9763-2517765cbd15 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:38.512869 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-09263e4a-2311-4cb1-9763-2517765cbd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:38.611623 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 743/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:38.655050 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:38.656724 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:38.666679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:38.803400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c200bf-fb0a-4ad3-9087-0e371d558f8a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:38.883259 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:38.919510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:38.920133 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:38.920448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:38.920728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:38.922357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:39.010227 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:39.011845 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a1c3-8331-4f22-9cfb-f5e544c12534 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:39.031023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 738/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:41.198506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.199050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.199050 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.200447 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 744/1482] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:41.205499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa073-8b87-4e18-ae39-5c541b12233c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.205910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa073-8b87-4e18-ae39-5c541b12233c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.206052 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa073-8b87-4e18-ae39-5c541b12233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.270995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bdeaa073-8b87-4e18-ae39-5c541b12233c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:41.272209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bdeaa073-8b87-4e18-ae39-5c541b12233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.318731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:41.369389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 739/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:41.405766 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:41.407765 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.432340 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:41.513710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031fbbd-1817-45bd-baa7-0ce85ff91825 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:41.708363 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:41.708990 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.709269 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.709541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.711159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:41.819217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:41.820717 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1471c-99f8-41ae-bed3-c5c61c7006ad service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:41.839832 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 745/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:43.914107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:43.914684 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:43.914684 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:43.916010 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 740/1485] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:43.921364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa208-f7bb-43a3-a395-90ca668c1938 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:43.921827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa208-f7bb-43a3-a395-90ca668c1938 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:43.921933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa208-f7bb-43a3-a395-90ca668c1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:43.987670 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8c5aa208-f7bb-43a3-a395-90ca668c1938 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:43.988918 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8c5aa208-f7bb-43a3-a395-90ca668c1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.085085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 746/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:44.124711 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:44.126286 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.230295 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8ee88-4037-4901-9e8e-e66d6644540f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:44.300952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:44.302882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:44.303547 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:44.304027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:44.304498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:44.306564 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.419438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:44.420839 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbee6e-0c31-43d6-90a8-0aeba8672cfb service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:44.439523 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 741/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:46.559401 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.559991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.559991 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.561377 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 747/1488] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:46.567326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a062d-64c2-4acd-bda8-eb189d9f06e0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.567731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a062d-64c2-4acd-bda8-eb189d9f06e0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.567888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a062d-64c2-4acd-bda8-eb189d9f06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.633671 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-876a062d-64c2-4acd-bda8-eb189d9f06e0 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:46.634823 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-876a062d-64c2-4acd-bda8-eb189d9f06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:46.690879 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:46.737041 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 742/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:46.778564 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:46.780105 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:46.816156 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:46.883411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb890f2-f03c-4c9d-880b-de1efd08763f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:46.958438 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:46.959051 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.959329 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.959598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.961256 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:47.046565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:47.076847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:47.078305 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ce7fc-8df3-4a3b-a87b-7b8145cb039d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:47.097187 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 748/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:49.381115 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.381675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.381675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.383073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 743/1491] 10.222.0.40 () {54 vars in 926 bytes} [Sun Jul 31 01:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:49.389052 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6355-a4ee-49dd-ade5-440631ac4a0c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.389490 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6355-a4ee-49dd-ade5-440631ac4a0c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.389598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6355-a4ee-49dd-ade5-440631ac4a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.454759 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f31d6355-a4ee-49dd-ade5-440631ac4a0c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:49.456031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f31d6355-a4ee-49dd-ade5-440631ac4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.558914 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 749/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:07:49.598593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:49.600129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.710852 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d982e5-2b0d-4abc-a858-ce2c29689b8a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:49.786736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:49.787380 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.787702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.787977 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.789664 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.800609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:49.910908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:49.912430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178e955-412b-4419-aaa7-023b8ec28e9a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:49.934002 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 744/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:59.556980 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=82 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:59.931013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=50 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:18.528454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:18.529080 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:18.529080 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:18.605206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:18.606434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:18.704467 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 750/1494] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:18.713498 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:18.714026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:18.714026 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:18.798598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:18.799767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:18.899625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 745/1495] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:18.904584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:18.906039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:18.917478 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745ce8e-294a-4877-bc94-9ba03f72dfc8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:18.981935 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:19.016553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.017181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.017459 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.017731 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.018425 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:09:19.018729 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.019737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.019737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:09:19.019737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:09:19.020801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.032165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 751/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Jul 31 01:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:09:19.041036 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.050394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4db75-b842-4f18-91ae-21aaf166d66a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.118999 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:19.157881 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.158507 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.158784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.159053 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.159725 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.162321 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.162321 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:09:19.162321 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:09:19.163525 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.221606 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 746/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Jul 31 01:09:19 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:09:19.226285 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.228052 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.262261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592c33-456c-426f-beef-7b136e945cd2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.361532 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.361919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.362197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.362465 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.363205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.364647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.364647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:09:19.364647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:09:19.365927 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.410875 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 752/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:09:19 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:09:19.416211 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.417808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.484736 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12559fb-1075-4799-aca6-6a0ce4d49f3d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.568577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:19.580506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.581132 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.581440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.581713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.582409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.583885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.583885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:09:19.583885 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:09:19.584805 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.597842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 747/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:09:19.601841 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.603402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.615350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478959-5a1f-4da5-8158-af89e857b9b6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.640418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:19.708737 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.709398 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.709708 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.709988 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.710693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.711739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.711739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:09:19.711739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:09:19.712675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c4fd5-7664-4808-8541-2617b4f81ebe admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.725404 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 753/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:09:19.729670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.731199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.766630 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033027e8-4b8c-43d3-91cf-4d3b673327c4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.878116 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:19.878729 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.879011 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.879290 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] PATH_INFO: `/v3/projects/241fbcce55d747aca1d0f85cc12efe93/users/fa0b14b150c84017aa3b6586476489b5/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.902625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=241fbcce55d747aca1d0f85cc12efe93, user_id=fa0b14b150c84017aa3b6586476489b5, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:19.903677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:19.903677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:09:19.903677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:09:19.905666 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718d9a-06de-451d-8cad-69c6d959d39a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:19.931568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 748/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:09:19 2022] PUT /identity/v3/projects/241fbcce55d747aca1d0f85cc12efe93/users/fa0b14b150c84017aa3b6586476489b5/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:09:19.945139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc31-3767-44cb-b402-11f3bba1ce1e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.945428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc31-3767-44cb-b402-11f3bba1ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.945707 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc31-3767-44cb-b402-11f3bba1ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.001997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f3e5fc31-3767-44cb-b402-11f3bba1ce1e None None] MFA Rules not processed for user `fa0b14b150c84017aa3b6586476489b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:20.003189 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f3e5fc31-3767-44cb-b402-11f3bba1ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.084987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 754/1502] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:20.098044 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.098357 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.099355 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.100897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 749/1503] 10.222.0.40 () {54 vars in 964 bytes} [Sun Jul 31 01:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:20.105604 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4297276-4afb-48c5-a767-30adb384c0e7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.105893 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4297276-4afb-48c5-a767-30adb384c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.106171 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4297276-4afb-48c5-a767-30adb384c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.163173 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.210965 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d4297276-4afb-48c5-a767-30adb384c0e7 None None] MFA Rules not processed for user `1064e968daa5452983255aeec2883691`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:20.212170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d4297276-4afb-48c5-a767-30adb384c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.285571 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 755/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Sun Jul 31 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:20.294051 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:20.295635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.345065 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.402609 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf979c-ec0c-439c-87bf-564ad7dab302 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:20.494743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1064e968daa5452983255aeec2883691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:20.495369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.495653 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.495927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.497583 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.596516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:20.597970 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:20.601511 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.615910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 750/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:20.663025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71074-fc55-4ac9-a6bf-04a923b2b44b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.663453 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71074-fc55-4ac9-a6bf-04a923b2b44b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.663590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71074-fc55-4ac9-a6bf-04a923b2b44b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.664920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 756/1506] 10.222.0.40 () {52 vars in 830 bytes} [Sun Jul 31 01:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:20.668550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:20.669806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.779734 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21738dc-e7b5-410f-98da-e54c7ecff258 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:20.879315 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:20.880647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.880937 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.881216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] PATH_INFO: `/v3/users/fa0b14b150c84017aa3b6586476489b5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.894604 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0b14b150c84017aa3b6586476489b5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:20.895768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:20.895768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:09:20.895768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:09:20.897034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:20.907495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.967117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0b14b150c84017aa3b6586476489b5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:20.967664 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0b14b150c84017aa3b6586476489b5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:20.968097 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0b14b150c84017aa3b6586476489b5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:20.991744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0b14b150c84017aa3b6586476489b5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:21.000840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0b14b150c84017aa3b6586476489b5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:21.022143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 751/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Jul 31 01:09:20 2022] DELETE /identity/v3/users/fa0b14b150c84017aa3b6586476489b5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:09:21.026569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.026861 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.027145 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.084068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:21.085328 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.160118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:21.174392 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 757/1508] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:21.185057 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:21.186299 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.284273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c88d-66cf-4bbd-a6c8-95b8dbdfa0fb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:21.339424 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:21.359514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:21.360308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.360649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.360975 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.362890 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.473905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:21.475528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca1b4-e508-4bd9-9751-38223c6e515b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:21.502481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 752/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:21.833652 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:21.834999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.846526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75413f3a-cdf5-4f8d-ae40-efd0097dc43c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:21.944362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:21.945004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.945283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.945554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] PATH_INFO: `/v3/projects/241fbcce55d747aca1d0f85cc12efe93` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.955774 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=241fbcce55d747aca1d0f85cc12efe93)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:21.956848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:21.956848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:09:21.956848 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:09:21.958066 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:22.016580 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241fbcce55d747aca1d0f85cc12efe93', 'request_id': 'req-b9d643d2-b567-4f48-b28e-e0b3db50a27c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:22.029402 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241fbcce55d747aca1d0f85cc12efe93', 'request_id': 'req-b9d643d2-b567-4f48-b28e-e0b3db50a27c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:22.035308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241fbcce55d747aca1d0f85cc12efe93', 'request_id': 'req-b9d643d2-b567-4f48-b28e-e0b3db50a27c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:22.062365 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] The token cache is being invalidate because project 241fbcce55d747aca1d0f85cc12efe93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:09:22.062661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:22.063185 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b9d643d2-b567-4f48-b28e-e0b3db50a27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:09:22.064819 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 758/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Jul 31 01:09:21 2022] DELETE /identity/v3/projects/241fbcce55d747aca1d0f85cc12efe93 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:09:31.500031 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=62 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:32.060238 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:39.113203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.113806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.113806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.115177 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:39.120165 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ae98-8cc7-42f4-b6fb-643e94c4b040 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.120639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ae98-8cc7-42f4-b6fb-643e94c4b040 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.120745 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ae98-8cc7-42f4-b6fb-643e94c4b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.206461 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4356ae98-8cc7-42f4-b6fb-643e94c4b040 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:39.207711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4356ae98-8cc7-42f4-b6fb-643e94c4b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:39.311636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:39.473714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:39.475897 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:39.597903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5091e-9a3e-49e0-8d7b-fb28e446b5b7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:39.604144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:39.604797 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.605082 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.605360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.613566 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:39.615199 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155a496-3fd1-4830-966f-5f1501df0e7a service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:39.624586 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 754/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:40.450230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9770-a3af-40dd-a168-f5a462ac11d0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:40.450789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9770-a3af-40dd-a168-f5a462ac11d0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:40.450789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9770-a3af-40dd-a168-f5a462ac11d0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:40.452169 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:40.457472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d4d-2931-4c8c-b01f-1dcac7e00447 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:40.457903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d4d-2931-4c8c-b01f-1dcac7e00447 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:40.458107 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d4d-2931-4c8c-b01f-1dcac7e00447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:40.479669 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dae40d4d-2931-4c8c-b01f-1dcac7e00447 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:40.480978 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dae40d4d-2931-4c8c-b01f-1dcac7e00447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:40.489632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:40.641106 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9770-a3af-40dd-a168-f5a462ac11d0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:40.655883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9770-a3af-40dd-a168-f5a462ac11d0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:40.662170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:40.662780 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:40.663063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:40.663341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:40.671805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:40.673479 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139288b-517b-4cce-b90c-471e03897e48 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:40.683868 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 761/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:44.517971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4b0c2-b7db-4886-a3a7-57113f7665f9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:44.518531 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4b0c2-b7db-4886-a3a7-57113f7665f9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:44.518531 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4b0c2-b7db-4886-a3a7-57113f7665f9 None None] PATH_INFO: `/v3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:44.519888 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 756/1517] 10.222.0.65 () {54 vars in 925 bytes} [Sun Jul 31 01:10:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:10:44.527146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d83d8-2637-41fa-8f6f-ede522c6d976 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:44.527607 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d83d8-2637-41fa-8f6f-ede522c6d976 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:44.527711 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d83d8-2637-41fa-8f6f-ede522c6d976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:44.591690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bd9d83d8-2637-41fa-8f6f-ede522c6d976 None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:44.592964 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bd9d83d8-2637-41fa-8f6f-ede522c6d976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:44.610928 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:44.667142 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 762/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Sun Jul 31 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:48.497790 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615ad7-9122-4add-8d7a-800807a16bbc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:48.498375 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615ad7-9122-4add-8d7a-800807a16bbc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:48.498635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615ad7-9122-4add-8d7a-800807a16bbc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:48.499998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 757/1519] 10.222.0.40 () {54 vars in 961 bytes} [Sun Jul 31 01:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:48.505214 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cf05-afd9-410f-8df9-d5d27729ed94 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:48.505714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cf05-afd9-410f-8df9-d5d27729ed94 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:48.505822 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cf05-afd9-410f-8df9-d5d27729ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:48.527828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c231cf05-afd9-410f-8df9-d5d27729ed94 None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:48.529083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c231cf05-afd9-410f-8df9-d5d27729ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:48.538014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 763/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Jul 31 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:48.545516 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615ad7-9122-4add-8d7a-800807a16bbc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:48.559614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615ad7-9122-4add-8d7a-800807a16bbc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:48.564689 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:48.565310 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:48.565599 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:48.565887 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:48.575069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:48.576714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63b471-5695-4434-8494-3378676de9ed service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:48.586594 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 758/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:52.045912 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b62aa-9acd-4b3f-8c38-baac0253a189 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:52.046450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b62aa-9acd-4b3f-8c38-baac0253a189 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:52.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b62aa-9acd-4b3f-8c38-baac0253a189 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:52.047887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:52.053693 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60769147-42db-4e6c-82b5-84b9c3971ba4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:52.054144 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60769147-42db-4e6c-82b5-84b9c3971ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:52.054270 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60769147-42db-4e6c-82b5-84b9c3971ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:52.073193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-60769147-42db-4e6c-82b5-84b9c3971ba4 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:52.074402 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-60769147-42db-4e6c-82b5-84b9c3971ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:52.082170 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:52.239004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b62aa-9acd-4b3f-8c38-baac0253a189 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:52.255223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b62aa-9acd-4b3f-8c38-baac0253a189 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:52.261489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:52.262208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:52.262400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:52.262678 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:52.271308 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:52.273432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e4eb-99c0-462a-a421-7d259704dfb7 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:52.282884 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 765/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:53.133464 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f9ab-11eb-4242-a9a6-8d781a56888c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:53.134020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f9ab-11eb-4242-a9a6-8d781a56888c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:53.134020 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f9ab-11eb-4242-a9a6-8d781a56888c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:53.135404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:53.140340 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175ece-5d29-4757-9489-5ed9e01fb8ef None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:53.140791 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175ece-5d29-4757-9489-5ed9e01fb8ef None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:53.140961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175ece-5d29-4757-9489-5ed9e01fb8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:53.159661 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f0175ece-5d29-4757-9489-5ed9e01fb8ef None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:53.160890 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f0175ece-5d29-4757-9489-5ed9e01fb8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:53.168665 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:53.324105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f9ab-11eb-4242-a9a6-8d781a56888c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:53.338582 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f9ab-11eb-4242-a9a6-8d781a56888c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:53.343846 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:53.344486 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:53.344768 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:53.345040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:53.353610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:53.355183 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0f6e7-58d5-4a85-8b62-8f351e11f9e1 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:53.364613 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 761/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:57.313933 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:57.314495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:57.314495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:57.315816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:57.321761 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b7a8-2e85-46c2-ae9c-675caa0f1aa6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:57.322217 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b7a8-2e85-46c2-ae9c-675caa0f1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:57.322387 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b7a8-2e85-46c2-ae9c-675caa0f1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:57.343056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d197b7a8-2e85-46c2-ae9c-675caa0f1aa6 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:57.344293 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d197b7a8-2e85-46c2-ae9c-675caa0f1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:57.352121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:57.425194 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:57.426939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:57.504064 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91cbc8-a8ea-45fb-9b80-f851ac17f367 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:57.508342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:57.508961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:57.509251 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:57.509531 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:57.518426 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:57.519872 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65dc1-5944-4788-ba72-f1c1746f5293 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:57.529199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 768/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:59.537731 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60842357-c13c-4bf9-a918-fa56c07e4888 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.538292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60842357-c13c-4bf9-a918-fa56c07e4888 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.538292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60842357-c13c-4bf9-a918-fa56c07e4888 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.539688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:59.544855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69c860-a1a0-4197-a221-87dd081f65a7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.545288 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69c860-a1a0-4197-a221-87dd081f65a7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.545420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69c860-a1a0-4197-a221-87dd081f65a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.565768 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6a69c860-a1a0-4197-a221-87dd081f65a7 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:59.566984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6a69c860-a1a0-4197-a221-87dd081f65a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.574938 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:59.610914 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60842357-c13c-4bf9-a918-fa56c07e4888 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:59.622506 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60842357-c13c-4bf9-a918-fa56c07e4888 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:59.626013 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:59.626632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.626919 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.627201 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.636168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:59.637632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738d1b4-5f48-4a8d-92a7-c380191a6d1e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:59.647186 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 764/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:03.192583 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:03.193176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:03.193176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:03.194558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:03.199629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41ff2-b77c-4a28-ae02-a54eff17d371 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:03.200054 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41ff2-b77c-4a28-ae02-a54eff17d371 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:03.200195 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41ff2-b77c-4a28-ae02-a54eff17d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:03.207940 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=81 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:03.220534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bac41ff2-b77c-4a28-ae02-a54eff17d371 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:03.221744 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bac41ff2-b77c-4a28-ae02-a54eff17d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:03.230105 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:03.538817 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:03.540550 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:03.605436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:03.619205 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa59ce1-b60c-4816-9906-6dd4c12ed089 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:03.622805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1064e968daa5452983255aeec2883691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:03.623432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:03.623716 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:03.623996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:03.633455 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:03.634929 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f735f18-599b-4805-964e-6f1c2b10ec4f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:03.644374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 771/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:05.717481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:05.718345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:05.718522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:05.720032 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:05.725709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa929e-15a3-47f9-b1ec-618b9fc659c7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:05.726223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa929e-15a3-47f9-b1ec-618b9fc659c7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:05.726701 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa929e-15a3-47f9-b1ec-618b9fc659c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:05.748512 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-06fa929e-15a3-47f9-b1ec-618b9fc659c7 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:05.749734 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-06fa929e-15a3-47f9-b1ec-618b9fc659c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:05.758089 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:06.065718 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:06.067670 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:06.081463 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581869ba-7ca8-4c30-b3e2-4c8cafa2d2b7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:06.085008 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1064e968daa5452983255aeec2883691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:06.085633 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:06.085916 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:06.086194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:06.095611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:06.097083 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867928-a0ae-46e4-b9fc-d5af1a768a16 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:06.108371 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 767/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:15.743682 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=11 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:16.104037 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:27.639279 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4d37-69d6-43b1-adf4-b946bb0083a9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.639910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4d37-69d6-43b1-adf4-b946bb0083a9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.639910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4d37-69d6-43b1-adf4-b946bb0083a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.642460 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecacf07-c441-46ee-931b-4c1cf5f78334 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.642891 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecacf07-c441-46ee-931b-4c1cf5f78334 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.643023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecacf07-c441-46ee-931b-4c1cf5f78334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.658989 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0f3f4d37-69d6-43b1-adf4-b946bb0083a9 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:27.660510 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0f3f4d37-69d6-43b1-adf4-b946bb0083a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:27.663281 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6ecacf07-c441-46ee-931b-4c1cf5f78334 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:27.664508 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6ecacf07-c441-46ee-931b-4c1cf5f78334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:27.672283 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 773/1540] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:27.672448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 768/1541] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:27.677558 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.677845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.678118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.680971 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.681269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.681550 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.698345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:27.699560 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:27.702002 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:27.703160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:27.707591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 774/1542] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:27.710949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 769/1543] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:27.712222 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.715407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.721788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6b3f-8b29-4121-abc1-0dd9c747650b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.724216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba693624-40c4-457f-997e-46572f56f6dc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.726589 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.727200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.727487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.727764 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.728488 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:12:27.728792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.728896 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.729395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.729675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.730390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.730637 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:12:27.730941 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.731939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:27.731939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:12:27.731939 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:12:27.733330 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.743183 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 775/1544] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:12:27.745240 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 770/1545] 10.222.0.40 () {58 vars in 1153 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:12:27.754093 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.756838 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.764116 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9eb3-f481-46db-aa3d-846549e3754d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.766719 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbf06-ed03-4da9-8ffa-8c6a3c27e776 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.768865 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.769506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.769790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.770063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.770762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.771553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.771775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:27.771775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:12:27.771775 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:12:27.772166 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.772485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.772769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.772997 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.773431 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.775326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.813366 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 776/1546] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:12:27.817549 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.819390 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 771/1547] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:12:27.823352 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.883769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3350cc-aa46-4f82-95cc-979eb68003bd admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.888845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.889279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99f35-4ab0-4776-9484-20f6719ba309 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.889541 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.889763 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.890131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.890827 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.892845 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.894404 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.895038 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.895329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.895615 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.896345 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.897385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:27.897385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:12:27.897385 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:12:27.898625 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.919143 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 777/1548] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:12:27.920179 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.922143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 772/1549] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:12:27.926429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.931887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa954dd-d3b3-42b7-8c50-fcd4209f669b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.936303 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1df7-6e4d-4a41-ad7d-7f419f89ef68 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.936801 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.937418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.937703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.937982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.938703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.940351 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.941148 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.941843 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.942126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.942567 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.943317 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.944995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.950525 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 778/1550] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:27.954092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.955593 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 773/1551] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:27.959172 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.964060 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6b0f1-9ab1-473a-b490-b76d128397c9 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.968714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c4d8-81ec-4489-be1d-85e0ac5a50f1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:27.968842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.971546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.971546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.971546 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.972777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.974160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:27.974503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.974898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.975091 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.975417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.976027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:27.977649 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:27.985609 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 779/1552] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:12:27.992519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 774/1553] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:12:27.992685 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:27.993480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:28.000610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f03235-8b3d-4c35-b4cd-af7bc633047b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:28.003024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945363-4714-4b92-852f-764dbf52a84d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:28.005778 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:28.006444 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.006732 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.007010 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] PATH_INFO: `/v3/projects/8fca0de520f04787a09a0cfac626dbd9/users/9972bb496deb42028b95e7635a120716/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.008288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:28.008949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.009244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.009522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] PATH_INFO: `/v3/projects/e810bce2020f4eccbce277006a3a8470/users/eb8bc949ee2a4055b3920f1703114294/roles/65640d9c917344788480a7d50c0694c0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.022399 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fca0de520f04787a09a0cfac626dbd9, user_id=9972bb496deb42028b95e7635a120716, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:28.023436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:28.023436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:12:28.023436 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:12:28.024659 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e810bce2020f4eccbce277006a3a8470, user_id=eb8bc949ee2a4055b3920f1703114294, role_id=65640d9c917344788480a7d50c0694c0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:28.025428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ea367-bc11-45a7-a44a-38aba59a5086 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:28.027308 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436673b-4fb6-4a85-b9b7-949c490bf9c9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:28.038493 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 780/1554] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:27 2022] PUT /identity/v3/projects/8fca0de520f04787a09a0cfac626dbd9/users/9972bb496deb42028b95e7635a120716/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:12:28.039860 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 775/1555] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:27 2022] PUT /identity/v3/projects/e810bce2020f4eccbce277006a3a8470/users/eb8bc949ee2a4055b3920f1703114294/roles/65640d9c917344788480a7d50c0694c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:12:28.043666 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.044012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.044327 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.044779 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.045069 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.045344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.064898 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:28.066562 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] MFA Rules not processed for user `2b9bcfe6d1e745f3b5f4baf8fefbfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:28.066784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:28.068038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:28.110131 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:28.113264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:28.131385 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 781/1556] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:28.140101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 776/1557] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:28.141110 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:28.149534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:28.197400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab831a0-2529-4ef2-8b04-8637912dd954 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:28.201132 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:28.201760 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.202130 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.202439 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.204216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbe1ab-75f9-4d40-8b99-5604e314b549 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:28.208156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:28.208831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.209121 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.209399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.211913 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:28.213397 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850a3d-ed96-47a2-8c6d-205fdc9653d0 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:28.219215 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:28.220727 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:28.223186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 782/1558] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:12:28.230614 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 777/1559] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:12:34.319783 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.320343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.320343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.366906 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] MFA Rules not processed for user `eb8bc949ee2a4055b3920f1703114294`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:34.368625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:34.545700 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 783/1560] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:34.550448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.566129 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b0f12-9e4c-4d80-91b0-f06504ffa7d9 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.574216 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:34.575149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.575401 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.575913 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.576893 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:34.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cd984-1cc6-453c-8510-e2d2c94bd39b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:34.621406 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 778/1561] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Jul 31 01:12:34 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:12:34.625032 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.647270 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051815-f635-4cab-b0df-ed2c396b3b8c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.748247 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:34.749330 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.749625 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.749910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.750603 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:34.752982 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:34.782487 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.782807 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.783062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.793342 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 784/1562] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:12:34 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:12:34.797343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.818241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9c70-31f2-403d-8816-fba3455d2d8b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.823001 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:34.823632 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.823928 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.824208 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.824951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:34.827014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:34.828983 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:34.830676 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:34.833362 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:34.845605 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 785/1563] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:12:34.848124 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.858146 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338288f-1831-4c68-8769-320a2306463f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.863526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:34.864201 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.864788 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.864905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] PATH_INFO: `/v3/projects/2dbd29adefd04f808a564058b7cd601e/users/07ed1c48cbcc4ef1b2177f01ccef1ad9/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.883836 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dbd29adefd04f808a564058b7cd601e, user_id=07ed1c48cbcc4ef1b2177f01ccef1ad9, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:34.887293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:34.903777 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 786/1564] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:34 2022] PUT /identity/v3/projects/2dbd29adefd04f808a564058b7cd601e/users/07ed1c48cbcc4ef1b2177f01ccef1ad9/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:12:34.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.919665 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 779/1565] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:34.923808 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:34.934988 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb673-d051-4ca6-96d6-72fdd5ffaa0d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.982598 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6af0dc-e667-4543-83ad-d1294b9a14fa admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:34.995581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:34.996427 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:34.996981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:34.997432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:34.997824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:34.998159 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.000102 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.007562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.008222 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.008565 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.008859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.009783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.012910 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.023299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 787/1566] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:35.027433 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.041388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e87b8e-0f40-4c76-9fed-01431b738709 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.051910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.052908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.053195 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.053860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] PATH_INFO: `/v3/projects/2dbd29adefd04f808a564058b7cd601e/users/07ed1c48cbcc4ef1b2177f01ccef1ad9/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.057805 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dbd29adefd04f808a564058b7cd601e, user_id=07ed1c48cbcc4ef1b2177f01ccef1ad9, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.061235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.061392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 780/1567] 10.222.0.40 () {60 vars in 1153 bytes} [Sun Jul 31 01:12:34 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:12:35.067949 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.086454 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 788/1568] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:35 2022] PUT /identity/v3/projects/2dbd29adefd04f808a564058b7cd601e/users/07ed1c48cbcc4ef1b2177f01ccef1ad9/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:12:35.180991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c979-c11c-4e24-bcfc-602cd2df214b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.253326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.254100 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.254802 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.255274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.256160 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.258815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.313909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 781/1569] 10.222.0.40 () {60 vars in 1144 bytes} [Sun Jul 31 01:12:35 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:12:35.318450 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.330352 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f32fc-6eae-49a5-b3d1-72cf75bcb719 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.345212 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.345920 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.346209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.346590 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.347331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.349012 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.360411 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 789/1570] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:12:35.365472 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.377552 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbdae-564c-4f49-bd97-afd5741e3aa4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.383395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.384296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.384831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.384831 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] PATH_INFO: `/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a/users/c8f249861faf4ff78bc3841f195008ed/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.403722 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2a0ca8c5dc495f97de5c5e8428f23a, user_id=c8f249861faf4ff78bc3841f195008ed, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.406505 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.424362 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 782/1571] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:35 2022] PUT /identity/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a/users/c8f249861faf4ff78bc3841f195008ed/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:12:35.429298 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.449004 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef005d-ddf7-4de1-b3f1-f189cb0bf713 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.550706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.551516 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.552209 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.553085 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.553448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.555792 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ef668-e422-4659-9948-0b3aba4842d9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.569287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 790/1572] 10.222.0.40 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:35.573435 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.585674 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1aae2-651f-48ce-a319-1dd6b880c340 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:35.595394 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:35.596164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.596521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.596811 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] PATH_INFO: `/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a/users/c8f249861faf4ff78bc3841f195008ed/roles/43e7d1f737a84eeb8c30214ca5ccaae5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.600358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2a0ca8c5dc495f97de5c5e8428f23a, user_id=c8f249861faf4ff78bc3841f195008ed, role_id=43e7d1f737a84eeb8c30214ca5ccaae5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:35.603864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:35.617869 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 783/1573] 10.222.0.40 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:35 2022] PUT /identity/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a/users/c8f249861faf4ff78bc3841f195008ed/roles/43e7d1f737a84eeb8c30214ca5ccaae5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:12:41.582967 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54ef7-d7f0-4e34-9413-245038c19f23 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:41.583434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54ef7-d7f0-4e34-9413-245038c19f23 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:41.583511 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54ef7-d7f0-4e34-9413-245038c19f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:41.624908 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-57a54ef7-d7f0-4e34-9413-245038c19f23 None None] MFA Rules not processed for user `07ed1c48cbcc4ef1b2177f01ccef1ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:41.626290 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-57a54ef7-d7f0-4e34-9413-245038c19f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:41.662855 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:41.715301 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 791/1574] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:41.739632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:41.744037 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:41.818979 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:41.867926 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572723-494f-4cac-acff-38cad6fcf551 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:41.874854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0d2b6058dd4609aef49555bb568453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:41.874854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:41.875130 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:41.875461 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:41.970616 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:41.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce4bf7-db3b-4c01-aa6c-e184e02cd1ac service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:41.997955 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 784/1575] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:42.237688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:42.238049 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:42.238338 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:42.257816 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:42.258396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:42.258895 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:42.283257 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] MFA Rules not processed for user `c8f249861faf4ff78bc3841f195008ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:42.285568 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:42.320358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:42.321854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:42.369514 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 792/1576] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:42.383101 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:42.394069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65a96-bb2d-4f96-a778-acae64d67676 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:42.397781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0d2b6058dd4609aef49555bb568453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:42.398702 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:42.399150 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:42.399582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:42.412197 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 785/1577] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:42.478259 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:42.479897 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65aacd-21fe-45aa-8166-6ee59db01cbf service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:42.491005 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 793/1578] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:12:42.562137 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:42.563827 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:42.648874 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:42.702577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6f64-2603-47e8-9983-898c5f00d1fa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:42.710062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:42.710714 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:42.710998 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:42.711422 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:42.720728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:42.723110 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:42.742367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 786/1579] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 01:12:44.241170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f500ea-a373-488a-a229-f4cf57c6b788 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:44.241669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f500ea-a373-488a-a229-f4cf57c6b788 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:44.241961 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f500ea-a373-488a-a229-f4cf57c6b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:44.266293 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-05f500ea-a373-488a-a229-f4cf57c6b788 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:44.268524 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-05f500ea-a373-488a-a229-f4cf57c6b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:44.284372 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 794/1580] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:44.337815 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:44.356842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1f29-e4f4-47d3-9f2f-8da48d05f03d service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:44.404014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:44.425883 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:44.426543 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:44.427277 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:44.451947 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:44.455972 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbd153-931d-42d6-aa67-9ebcb466b470 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:44.478284 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 787/1581] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:53.424793 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0ae60-8a7c-4f10-85e2-215587e9cf99 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.425264 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0ae60-8a7c-4f10-85e2-215587e9cf99 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.425364 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0ae60-8a7c-4f10-85e2-215587e9cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:53.449041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-25c0ae60-8a7c-4f10-85e2-215587e9cf99 None None] MFA Rules not processed for user `eb8bc949ee2a4055b3920f1703114294`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:53.450891 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-25c0ae60-8a7c-4f10-85e2-215587e9cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:53.461644 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 795/1582] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:53.767439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e6e6-9dba-4af1-8145-36401f516222 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.768610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e6e6-9dba-4af1-8145-36401f516222 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.768692 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e6e6-9dba-4af1-8145-36401f516222 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:53.770994 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 788/1583] 10.222.0.40 () {54 vars in 962 bytes} [Sun Jul 31 01:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:53.778634 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6ad3-6ab4-4f99-9550-bf8c104806bc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.780287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6ad3-6ab4-4f99-9550-bf8c104806bc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.780287 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6ad3-6ab4-4f99-9550-bf8c104806bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:53.823622 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6ddc6ad3-6ab4-4f99-9550-bf8c104806bc None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:53.825033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6ddc6ad3-6ab4-4f99-9550-bf8c104806bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:53.848581 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:53.901127 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 796/1584] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Jul 31 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:53.906697 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.906984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.907261 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:53.909269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 789/1585] 10.222.0.40 () {54 vars in 912 bytes} [Sun Jul 31 01:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:53.917812 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c1a-b5c0-4971-a7ac-0c6ca34026ea None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.918280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c1a-b5c0-4971-a7ac-0c6ca34026ea None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.918727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c1a-b5c0-4971-a7ac-0c6ca34026ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:53.945769 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e92d2c1a-b5c0-4971-a7ac-0c6ca34026ea None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:53.946916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e92d2c1a-b5c0-4971-a7ac-0c6ca34026ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:53.956639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 797/1586] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:53.968677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:53.970526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:53.984769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a0b-3e5b-4d08-b3e4-f11e99020565 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:53.988359 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0d2b6058dd4609aef49555bb568453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:53.988986 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:53.989274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:53.989553 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.000209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:54.001690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56cd4-ad6b-4de5-abbd-21a310b19195 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:54.013691 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 790/1587] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:54.351125 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97233a96-667c-4625-bacb-0bae22cfad20 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.351415 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97233a96-667c-4625-bacb-0bae22cfad20 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.351694 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97233a96-667c-4625-bacb-0bae22cfad20 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.353091 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 798/1588] 10.222.0.40 () {54 vars in 912 bytes} [Sun Jul 31 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:54.358407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630ceb-e65a-423d-85dc-6efd59c25d52 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.358702 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630ceb-e65a-423d-85dc-6efd59c25d52 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.358985 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630ceb-e65a-423d-85dc-6efd59c25d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.402164 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7c630ceb-e65a-423d-85dc-6efd59c25d52 None None] MFA Rules not processed for user `9f13b2c9e912492a8e8fb7fec70236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:54.403439 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7c630ceb-e65a-423d-85dc-6efd59c25d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:54.455798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 791/1589] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:54.467031 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97233a96-667c-4625-bacb-0bae22cfad20 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:54.478217 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97233a96-667c-4625-bacb-0bae22cfad20 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:54.481883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:54.482518 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.482794 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.483086 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.491281 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:54.492773 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2babf3-8a4c-447e-878f-cbc2dfd1ffa1 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:54.500907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 799/1590] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:54.916078 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f41dd-9927-4deb-8a6d-5a15925ea098 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.916682 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f41dd-9927-4deb-8a6d-5a15925ea098 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.916872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f41dd-9927-4deb-8a6d-5a15925ea098 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.918251 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 792/1591] 10.222.0.40 () {54 vars in 962 bytes} [Sun Jul 31 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:12:54.924770 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a0c-31e0-4f3b-97cd-260ec4e2edd6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.925174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a0c-31e0-4f3b-97cd-260ec4e2edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.925627 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a0c-31e0-4f3b-97cd-260ec4e2edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.940863 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a553b6-94ea-422f-996e-44d69c4036ee None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.941292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a553b6-94ea-422f-996e-44d69c4036ee None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.941601 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a553b6-94ea-422f-996e-44d69c4036ee None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.943034 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 793/1592] 10.222.0.40 () {54 vars in 961 bytes} [Sun Jul 31 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:54.953220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.953510 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.953794 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.974834 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-58226a0c-31e0-4f3b-97cd-260ec4e2edd6 None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:54.978225 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-58226a0c-31e0-4f3b-97cd-260ec4e2edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:54.990679 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:54.991909 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:54.992144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 800/1593] 10.222.0.40 () {58 vars in 1059 bytes} [Sun Jul 31 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:54.997570 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbacc-42a6-4aea-a59c-ef4c4d4cfcda None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:54.997862 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbacc-42a6-4aea-a59c-ef4c4d4cfcda None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:54.998141 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbacc-42a6-4aea-a59c-ef4c4d4cfcda None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:54.999610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 801/1594] 10.222.0.40 () {54 vars in 912 bytes} [Sun Jul 31 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:12:55.004235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:55.004610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:55.004847 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:55.024292 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:55.025545 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:55.035381 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 802/1595] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:12:55.053521 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:55.057167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 794/1596] 10.222.0.40 () {58 vars in 1058 bytes} [Sun Jul 31 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:55.063074 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa7af-cc84-4f82-9579-3c98e7aa7d0c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:55.065022 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:55.066853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:55.067502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:55.067789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:55.068092 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:55.074578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0add72-f5b9-431a-9646-b3c36b5df9c5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:55.079391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:55.079690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:55.080378 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:55.080667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:55.080943 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:55.081039 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406495e6-06dc-4e6a-a9f2-fd60f18ff02a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:55.082719 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:55.091751 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 803/1597] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:12:55.094389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:55.096596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:55.110574 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 795/1598] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:56.769614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e527e-9db8-4008-b577-6e6aa2f4cd27 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:56.770075 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e527e-9db8-4008-b577-6e6aa2f4cd27 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:56.770170 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e527e-9db8-4008-b577-6e6aa2f4cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:56.790359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-777e527e-9db8-4008-b577-6e6aa2f4cd27 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:56.791614 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-777e527e-9db8-4008-b577-6e6aa2f4cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:56.799027 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 804/1599] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:56.812142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:56.823688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de5-281d-48ed-ba7f-3d19f284d260 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:56.829220 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:56.830606 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:56.830840 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:56.831294 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:56.840322 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:56.842042 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:56.846539 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:56.853194 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 796/1600] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 01:13:06.785181 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=44 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:06.850381 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:11.750410 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8de2-2f1e-43af-a78f-05c143c1ed47 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:11.750963 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8de2-2f1e-43af-a78f-05c143c1ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:11.751259 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8de2-2f1e-43af-a78f-05c143c1ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:11.774434 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2a0d8de2-2f1e-43af-a78f-05c143c1ed47 None None] MFA Rules not processed for user `9f13b2c9e912492a8e8fb7fec70236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:11.775647 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2a0d8de2-2f1e-43af-a78f-05c143c1ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:11.782167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 805/1601] 10.222.0.65 () {58 vars in 1015 bytes} [Sun Jul 31 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:11.795124 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:11.805799 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7972ed6-81bf-43f3-af8a-4ccaf7b8d899 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:11.809420 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:11.810075 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:11.810389 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:11.810668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:11.818700 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:11.820088 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3d6e4-8f9e-4f3e-88e6-2744151442af service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:11.827995 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 797/1602] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:12.721610 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a88bc4-8c87-4701-9962-d046d4008ce8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:12.723158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a88bc4-8c87-4701-9962-d046d4008ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:12.723487 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a88bc4-8c87-4701-9962-d046d4008ce8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:12.726699 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 806/1603] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:13:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:12.797927 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260e12-f0f7-47fc-a4c7-072061dba0fe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:12.798967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260e12-f0f7-47fc-a4c7-072061dba0fe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:12.798967 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260e12-f0f7-47fc-a4c7-072061dba0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:12.830106 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7f260e12-f0f7-47fc-a4c7-072061dba0fe None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:12.831932 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7f260e12-f0f7-47fc-a4c7-072061dba0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:12.841743 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 798/1604] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:12.861916 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a88bc4-8c87-4701-9962-d046d4008ce8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:12.878229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a88bc4-8c87-4701-9962-d046d4008ce8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:12.884842 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:12.885626 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:12.886758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:12.886758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:12.897641 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:12.899417 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cf3e6-f830-489b-9412-c8197d23700f service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:12.911886 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 807/1605] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:13:20.644908 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bbab-bcf3-47d5-85ac-c4b9227a827a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:20.645534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bbab-bcf3-47d5-85ac-c4b9227a827a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:20.645534 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403bbab-bcf3-47d5-85ac-c4b9227a827a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:20.646828 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 799/1606] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:20.657065 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:20.657617 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:20.657898 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:20.681068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:20.682303 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:20.692758 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 808/1607] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:20.709370 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403bbab-bcf3-47d5-85ac-c4b9227a827a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:20.724475 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403bbab-bcf3-47d5-85ac-c4b9227a827a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:20.729905 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:20.730555 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:20.730844 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:20.731127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:20.740660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:20.742261 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4160-4764-4c22-961d-a88a8b56c8be service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:20.753781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 800/1608] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:30.676234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=12 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:30.748358 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=15 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:43.058038 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:43.068083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ac559-35f2-4da1-90da-85fdd3c6efda None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:43.071710 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:43.072350 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:43.072635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:43.072904 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:43.081789 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:43.083223 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9959-3443-43c1-ab12-bc841776f425 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:43.092849 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 809/1609] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:50.810747 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:50.811367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:50.811367 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:50.832279 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:50.834167 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:50.841269 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 801/1610] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:51.278956 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722c68-142d-4c21-88aa-5815717fd792 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:51.279509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722c68-142d-4c21-88aa-5815717fd792 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:51.279509 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722c68-142d-4c21-88aa-5815717fd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:51.300200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-80722c68-142d-4c21-88aa-5815717fd792 None None] MFA Rules not processed for user `9f13b2c9e912492a8e8fb7fec70236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:51.302224 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-80722c68-142d-4c21-88aa-5815717fd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:51.309704 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 810/1611] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:51.322485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:51.332398 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09497b8-dfef-481d-a382-3ef584db2cd6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:51.336171 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:51.336836 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:51.337292 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:51.337414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:51.345272 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:51.346720 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1714b-c797-4c2b-bed7-c6898b43cdaa service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:51.354713 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 802/1612] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:01.295376 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:01.351597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=9 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:53.186011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:53.186547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:53.186547 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:53.206296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:53.207526 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:53.214693 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 811/1613] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:03.201025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:11.271247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a143-0f50-472b-b705-4fc8efbd0203 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:11.271992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a143-0f50-472b-b705-4fc8efbd0203 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:11.271992 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a143-0f50-472b-b705-4fc8efbd0203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:11.293386 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ec77a143-0f50-472b-b705-4fc8efbd0203 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:11.294597 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ec77a143-0f50-472b-b705-4fc8efbd0203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:11.301984 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 803/1614] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:11.342503 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:11.354680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bbd33-f241-4504-8f13-427fa94b9a46 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:11.359593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:11.360218 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:11.360534 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:11.360814 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:11.368983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:11.370593 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:11.378680 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 812/1615] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:16.763411 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b4f1-4842-4795-9bd5-142229b74c34 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.763922 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b4f1-4842-4795-9bd5-142229b74c34 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.764056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b4f1-4842-4795-9bd5-142229b74c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.783014 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-82a3b4f1-4842-4795-9bd5-142229b74c34 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:16.784221 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-82a3b4f1-4842-4795-9bd5-142229b74c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.791872 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 804/1616] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:21.375544 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:26.778278 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:49.045803 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:49.057176 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b1f4-50d3-4ac6-a655-3286873c870c service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:49.062192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:49.062816 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:49.063102 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:49.063379 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:49.073052 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:49.074830 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:49.084829 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 813/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:50.067660 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881372-5d8a-4bde-974b-853414cba1d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:50.068193 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881372-5d8a-4bde-974b-853414cba1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:50.068477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881372-5d8a-4bde-974b-853414cba1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:50.094135 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c5881372-5d8a-4bde-974b-853414cba1d8 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:50.095430 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c5881372-5d8a-4bde-974b-853414cba1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:50.104946 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 805/1618] 10.222.0.40 () {58 vars in 967 bytes} [Sun Jul 31 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:50.118164 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:50.130099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7c376-0798-4fcd-a899-34b14ef5bda9 service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:50.136615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:50.136984 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:50.137188 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:50.137391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:50.146575 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:50.148286 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:50.157158 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 814/1619] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:16:00.084073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:00.153698 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=12 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:13.210360 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47194f0-68e4-414b-8edc-c07252cee216 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.210861 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47194f0-68e4-414b-8edc-c07252cee216 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.210948 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47194f0-68e4-414b-8edc-c07252cee216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.231228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b47194f0-68e4-414b-8edc-c07252cee216 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:13.232529 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b47194f0-68e4-414b-8edc-c07252cee216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:13.239369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 806/1620] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:23.226028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:31.770639 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:31.772069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:31.784192 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259065b7-9da6-4233-a262-42785bd1a7ff service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:31.787762 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:31.788400 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:31.788684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:31.788958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:31.797786 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:31.799197 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bf6a6-f720-4288-8624-d82ab4f5fa26 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:31.808718 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 815/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:33.809395 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1368a-ec1b-4004-a04f-e96d7925cbca None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:33.809912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1368a-ec1b-4004-a04f-e96d7925cbca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:33.809912 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1368a-ec1b-4004-a04f-e96d7925cbca None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:33.811243 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 807/1622] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:33.816240 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:33.816757 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:33.816857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:33.837117 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] MFA Rules not processed for user `d7b7ff8e53f84c30a43f0f8218ef6d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:33.838343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:33.848451 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 816/1623] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:16:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:33.861690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1368a-ec1b-4004-a04f-e96d7925cbca None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:33.879344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1368a-ec1b-4004-a04f-e96d7925cbca None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:33.894382 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:33.895575 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:33.896039 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:33.897074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:33.910028 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:33.911710 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:33.922784 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 808/1624] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:43.831636 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:43.918457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:14.548331 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.559706 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244729bb-f5d2-4fea-88cd-1d80dea535df None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.566035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.566663 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.566950 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.567221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.575041 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.576675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.585907 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 817/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:14.633675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.642684 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d07c3-8d2c-4de6-8c8d-c64babc500d8 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.646231 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.646842 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.647126 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.647399 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.657871 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.659306 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.669882 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 809/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:15.091163 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:15.113902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ffced-4c34-4746-b46e-4f3901ef415d service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:15.120022 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:15.121233 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.121720 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.122221 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.136736 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:15.139237 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.156333 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 818/1627] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:15.225145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:15.236522 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3093e1-4458-4c54-ae87-343a389341a9 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:15.241627 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:15.242273 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.242558 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.243023 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.253824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:15.256147 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de36c-f0c8-4cb2-a473-44325689b9a4 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.269658 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 810/1628] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:16.507930 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:16.568863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99487c-7df9-4215-8c3f-1ce52ed25ae5 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:16.572657 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1064e968daa5452983255aeec2883691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:16.573299 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:16.573587 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:16.573863 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:16.584502 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:16.585958 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:16.599196 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 819/1629] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:21.863952 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dea8-7274-4991-9fce-a1f7c4011547 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.864429 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dea8-7274-4991-9fce-a1f7c4011547 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.864577 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dea8-7274-4991-9fce-a1f7c4011547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.884931 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5f49dea8-7274-4991-9fce-a1f7c4011547 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:21.886176 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5f49dea8-7274-4991-9fce-a1f7c4011547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:21.894062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 811/1630] 10.222.0.40 () {58 vars in 967 bytes} [Sun Jul 31 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:21.939175 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.950234 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9381bf-a367-4597-91a3-1b65595379e1 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.955985 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.956624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.956909 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.957186 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.965167 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.966747 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.974618 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 820/1631] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:22.456071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac981-3ca5-41b4-a4fb-13d73d3a52a3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.456417 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac981-3ca5-41b4-a4fb-13d73d3a52a3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.456698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac981-3ca5-41b4-a4fb-13d73d3a52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.476203 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-efeac981-3ca5-41b4-a4fb-13d73d3a52a3 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:22.477440 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-efeac981-3ca5-41b4-a4fb-13d73d3a52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:22.485344 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 812/1632] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:22.497261 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:22.508230 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd75c2-7c3b-4258-b21b-fdcc288844f8 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.513409 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.514025 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.514312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.514591 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.522565 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.524147 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.532878 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 821/1633] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:30.770101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.770675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.770675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.789427 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] MFA Rules not processed for user `eb8bc949ee2a4055b3920f1703114294`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:30.790667 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.797521 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 813/1634] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:31.058679 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.068418 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05520-a0c6-493a-ab47-e8257d363047 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.071987 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.072630 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.072919 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.073199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.080207 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.081675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278e77-28f6-4c3e-bf9e-fb5e3eea9544 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.089656 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 822/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:31.606151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.618392 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f761-3efc-4672-bc0a-1ff549f5447f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.623282 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.623904 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.624192 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.624499 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.633968 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.635698 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.645942 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 814/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:32.795390 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.795906 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.796061 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.816388 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:32.817624 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.824910 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 823/1637] 10.222.0.40 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:32.837847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.849557 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3399bcd-0f67-42dd-b1e4-80a4d3d53f69 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.854635 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.855264 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.855549 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.855834 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.865180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:32.866791 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:32.879481 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 815/1638] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:18:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:42.811334 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=59 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:42.871929 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=33 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:48.042118 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.055344 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a4fd-5351-4e6e-b54c-85c2b32edcd1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.060852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.061483 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.061766 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.062042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.070216 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.071826 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68fba8-482a-4b08-9f2f-0ba60967ca41 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.081983 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 824/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:51.231145 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.244798 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1dfa0-83a6-4e6a-a57f-f983727ad083 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.252528 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.253256 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.253611 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.253973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.265409 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.267149 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.278457 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 816/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:51.922448 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.922928 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.923035 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.943034 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.944284 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.951336 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 825/1641] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:52.384859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.403074 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8752db0-d207-49bb-aedd-92d55f7e1775 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.413213 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.413854 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.414142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.414436 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.427803 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.430288 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.443067 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 817/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:01.937739 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.438410 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=12 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:05.231477 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.240974 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e04e-2f96-4bb6-bb3a-ab305511d9f0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.244553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.245235 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.245523 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.245800 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.255601 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.257076 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12100c-e07b-4cf3-8c4a-aea02752af4d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.267500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 826/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:15.262684 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:56.681906 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:56.741142 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544660-3e9e-44f7-9e04-52b116e4d1fe service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:56.746200 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:56.746876 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:56.747112 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:56.747396 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:56.749296 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:56.782598 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:56.784209 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1232bc-30b4-4971-9e37-e9ac0f0023c7 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:56.794647 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 818/1644] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:06.790526 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=36 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:12.626553 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:12.627099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:12.627099 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:12.645994 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] MFA Rules not processed for user `9972bb496deb42028b95e7635a120716`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:12.647199 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:12.654284 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 827/1645] 10.222.0.40 () {58 vars in 958 bytes} [Sun Jul 31 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:22.641112 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:35.719244 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:35.719728 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:35.719821 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:35.748496 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] MFA Rules not processed for user `1b4dc0771b604dfbb30663d5374bcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:35.749688 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:35.764961 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 819/1646] 10.222.0.40 () {58 vars in 967 bytes} [Sun Jul 31 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:35.806428 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:35.818976 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc39858-4acc-49cb-9145-bb5fd183a1a5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:35.823954 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa95647578f48108da5f532c53ae3c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:35.824616 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:35.824902 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:35.825184 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:35.834139 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:35.835729 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acf314-5f7a-4772-93c7-e9c9a44f103c service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:35.843688 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 828/1647] 10.222.0.40 () {60 vars in 1384 bytes} [Sun Jul 31 01:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:21:36.219746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:36.221432 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:36.255027 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d15e7-2ce9-430c-ae94-aeda0b674b76 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:36.258626 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:36.259247 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:36.259532 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:36.259810 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:36.327763 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:36.329271 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7fc24-fc14-45a7-a08e-8710f10ef743 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:36.347822 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 820/1648] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:39.632992 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870e5b-68b2-4cd7-94db-6d7c0110018e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:39.633499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870e5b-68b2-4cd7-94db-6d7c0110018e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:39.633499 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3870e5b-68b2-4cd7-94db-6d7c0110018e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:39.634840 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 829/1649] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:21:39.661752 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c90f-624d-4540-a551-e386ebb86a32 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:39.662291 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c90f-624d-4540-a551-e386ebb86a32 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:39.662448 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c90f-624d-4540-a551-e386ebb86a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:39.723503 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-acb8c90f-624d-4540-a551-e386ebb86a32 None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:39.724781 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-acb8c90f-624d-4540-a551-e386ebb86a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:39.736562 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 821/1650] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:39.745231 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3870e5b-68b2-4cd7-94db-6d7c0110018e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:39.760860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3870e5b-68b2-4cd7-94db-6d7c0110018e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:39.765860 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:39.766495 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:39.766781 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:39.767083 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:39.776635 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:39.778255 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5032-8718-4f7d-ad49-8319bba22cca service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:39.788732 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 830/1651] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:43.167094 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a80e-0879-40ad-8c98-d3f21d105b59 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.167675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a80e-0879-40ad-8c98-d3f21d105b59 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.167675 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a80e-0879-40ad-8c98-d3f21d105b59 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.169062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 822/1652] 10.222.0.40 () {54 vars in 921 bytes} [Sun Jul 31 01:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:21:43.196324 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.196850 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.197011 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.222714 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] MFA Rules not processed for user `f392d45213bd42c38601f9c654350526`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:43.224033 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:43.235042 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 831/1653] 10.222.0.40 () {58 vars in 1018 bytes} [Sun Jul 31 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:43.250156 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76a80e-0879-40ad-8c98-d3f21d105b59 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.252871 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.264853 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cae86f-5c25-4c41-9f0d-e2986fd1f3d8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.267108 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76a80e-0879-40ad-8c98-d3f21d105b59 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.269491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.270136 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.270420 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.270703 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] PATH_INFO: `/v3/users/eb8bc949ee2a4055b3920f1703114294` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.271894 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8bc949ee2a4055b3920f1703114294)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.272590 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.273020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:43.273020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: warnings.warn(msg) Jul 31 01:21:43.273020 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: Jul 31 01:21:43.273298 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.273477 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.273859 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.274160 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.282514 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.284690 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.294425 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 823/1654] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:43.342835 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8bc949ee2a4055b3920f1703114294'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.343482 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8bc949ee2a4055b3920f1703114294'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.353653 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8bc949ee2a4055b3920f1703114294'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.373244 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8bc949ee2a4055b3920f1703114294'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.373887 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8bc949ee2a4055b3920f1703114294'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.387078 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 832/1655] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:43 2022] DELETE /identity/v3/users/eb8bc949ee2a4055b3920f1703114294 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:43.560785 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.573632 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba79351-c186-4dad-a3af-16cafd2b5d42 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.622957 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:43.633127 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.633783 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.634071 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.634350 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] PATH_INFO: `/v3/projects/e810bce2020f4eccbce277006a3a8470` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.635519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e810bce2020f4eccbce277006a3a8470)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.636677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: WARNING py.warnings [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:43.636677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: warnings.warn(msg) Jul 31 01:21:43.636677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: Jul 31 01:21:43.638103 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.693519 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e810bce2020f4eccbce277006a3a8470', 'request_id': 'req-f76c0149-5ebb-4a78-9c41-7397ae966da5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.699413 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e810bce2020f4eccbce277006a3a8470', 'request_id': 'req-f76c0149-5ebb-4a78-9c41-7397ae966da5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.706629 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e810bce2020f4eccbce277006a3a8470', 'request_id': 'req-f76c0149-5ebb-4a78-9c41-7397ae966da5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.737024 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] The token cache is being invalidate because project e810bce2020f4eccbce277006a3a8470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:43.737241 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.737880 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.739441 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 824/1656] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:43 2022] DELETE /identity/v3/projects/e810bce2020f4eccbce277006a3a8470 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:43.743569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.745023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:43.759469 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698bd5-3f27-4de2-b671-eb2830a6f99d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.815811 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.816504 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.816790 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.817068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] PATH_INFO: `/v3/users/07ed1c48cbcc4ef1b2177f01ccef1ad9` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.818241 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ed1c48cbcc4ef1b2177f01ccef1ad9)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.820174 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.862128 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:43.868517 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ed1c48cbcc4ef1b2177f01ccef1ad9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.869660 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ed1c48cbcc4ef1b2177f01ccef1ad9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.877905 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ed1c48cbcc4ef1b2177f01ccef1ad9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.889862 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ed1c48cbcc4ef1b2177f01ccef1ad9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.890577 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ed1c48cbcc4ef1b2177f01ccef1ad9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.903690 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 833/1657] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:43 2022] DELETE /identity/v3/users/07ed1c48cbcc4ef1b2177f01ccef1ad9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:44.077877 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:44.079847 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:44.099923 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0149-5ebb-4a78-9c41-7397ae966da5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:44.170056 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:44.170716 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:44.170991 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:44.171274 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] PATH_INFO: `/v3/projects/2dbd29adefd04f808a564058b7cd601e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:44.172500 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dbd29adefd04f808a564058b7cd601e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:44.174476 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:44.223509 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dbd29adefd04f808a564058b7cd601e', 'request_id': 'req-936ba275-c696-4f7b-9268-ec4d000f14ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:44.229238 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dbd29adefd04f808a564058b7cd601e', 'request_id': 'req-936ba275-c696-4f7b-9268-ec4d000f14ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:44.237326 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dbd29adefd04f808a564058b7cd601e', 'request_id': 'req-936ba275-c696-4f7b-9268-ec4d000f14ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:44.249158 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] The token cache is being invalidate because project 2dbd29adefd04f808a564058b7cd601e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:44.249376 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:44.250062 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:44.251596 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 825/1658] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:44 2022] DELETE /identity/v3/projects/2dbd29adefd04f808a564058b7cd601e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:53.900023 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:54.246081 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:22.121582 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:22.125742 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:22.263296 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747a19-b621-4bfb-bb07-d2b8ca57ca71 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:22.296400 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:22.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:22.335939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:22.336608 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:22.336895 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:22.337169 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:22.338981 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:22.351673 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:22.353353 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:22.364568 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ba275-c696-4f7b-9268-ec4d000f14ef admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:22.366839 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 834/1659] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:22.368769 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:22.369407 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:22.369696 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:22.369976 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:22.371824 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:22.387047 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:22.388753 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:22.400767 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 826/1660] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:23.306566 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:23.315732 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59eefd-86f3-4465-a160-27f02fd47b39 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:23.319441 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:23.320068 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:23.320391 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:23.320675 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:23.322491 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:23.333144 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:23.334594 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:23.342709 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 835/1661] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:23.621864 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:23.632795 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdaa39-f945-4ba0-996f-bbf6e1a8a0fd service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:23.636495 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:23.637180 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:23.637414 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:23.637760 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:23.639600 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:23.654168 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:23.655610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:23.666497 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 827/1662] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:24.520727 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:24.523200 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:24.541900 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f50cd2-f690-4d59-b0bf-f88aa5a6911d service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:24.548371 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b7ff8e53f84c30a43f0f8218ef6d30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:24.548996 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:24.549280 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:24.549554 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:24.552452 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:24.566695 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:24.568311 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:24.578828 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 836/1663] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:23:33.661787 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=32 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:34.574501 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=83 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:34.740117 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:34.748668 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b581-1479-456c-b0ee-70fe07dfea36 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:34.752221 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f13b2c9e912492a8e8fb7fec70236bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:34.752855 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:34.753138 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:34.753982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:34.755751 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:34.820501 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:34.821369 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:34.831438 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 828/1664] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:41.119857 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:41.121650 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:41.136069 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a912-6d7a-43e9-9ee6-daa4b26e9597 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:41.142135 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:41.142784 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:41.143067 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:41.143345 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] PATH_INFO: `/v3/users/9972bb496deb42028b95e7635a120716` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:41.158951 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9972bb496deb42028b95e7635a120716)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:41.161615 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:41.207359 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9972bb496deb42028b95e7635a120716'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.208014 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9972bb496deb42028b95e7635a120716'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.214948 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9972bb496deb42028b95e7635a120716'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.227669 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9972bb496deb42028b95e7635a120716'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.228343 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9972bb496deb42028b95e7635a120716'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.241317 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 837/1665] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Jul 31 01:23:41 2022] DELETE /identity/v3/users/9972bb496deb42028b95e7635a120716 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:41.426638 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:41.437143 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9b81-b534-45a2-9812-afa8ec0e86e5 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:41.496480 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:41.497048 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:41.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:41.497603 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] PATH_INFO: `/v3/projects/8fca0de520f04787a09a0cfac626dbd9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:41.508636 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fca0de520f04787a09a0cfac626dbd9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:41.510610 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:41.559485 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fca0de520f04787a09a0cfac626dbd9', 'request_id': 'req-17a9dc71-080c-4217-ad78-a2fa5da1df96'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.564973 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fca0de520f04787a09a0cfac626dbd9', 'request_id': 'req-17a9dc71-080c-4217-ad78-a2fa5da1df96'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.572489 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fca0de520f04787a09a0cfac626dbd9', 'request_id': 'req-17a9dc71-080c-4217-ad78-a2fa5da1df96'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.585455 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] The token cache is being invalidate because project 8fca0de520f04787a09a0cfac626dbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:23:41.585746 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.586403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.587982 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 829/1666] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Jul 31 01:23:41 2022] DELETE /identity/v3/projects/8fca0de520f04787a09a0cfac626dbd9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:41.592037 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:41.593500 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:41.606432 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912434a-42a8-4de3-8d66-5ffac6126c2a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:41.662567 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:41.663220 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:41.663505 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:41.663785 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] PATH_INFO: `/v3/users/c8f249861faf4ff78bc3841f195008ed` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:41.677054 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f249861faf4ff78bc3841f195008ed)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:41.678999 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:41.723206 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f249861faf4ff78bc3841f195008ed'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.723852 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f249861faf4ff78bc3841f195008ed'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.728341 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:41.732063 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f249861faf4ff78bc3841f195008ed'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.745569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f249861faf4ff78bc3841f195008ed'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.746263 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f249861faf4ff78bc3841f195008ed'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:41.759726 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 838/1667] 10.222.0.40 () {58 vars in 1224 bytes} [Sun Jul 31 01:23:41 2022] DELETE /identity/v3/users/c8f249861faf4ff78bc3841f195008ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:41.941403 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:41.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:41.960578 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9dc71-080c-4217-ad78-a2fa5da1df96 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:41.973101 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:42.026645 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b9bcfe6d1e745f3b5f4baf8fefbfa18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a7020f93b24515b5df25cc753d8bc8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:42.027228 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:42.027524 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:42.027806 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] PATH_INFO: `/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:42.039055 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2a0ca8c5dc495f97de5c5e8428f23a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:42.041073 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:42.088095 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2a0ca8c5dc495f97de5c5e8428f23a', 'request_id': 'req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:42.093677 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2a0ca8c5dc495f97de5c5e8428f23a', 'request_id': 'req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:42.100962 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2a0ca8c5dc495f97de5c5e8428f23a', 'request_id': 'req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:42.113421 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] The token cache is being invalidate because project 8c2a0ca8c5dc495f97de5c5e8428f23a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:23:42.113712 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:42.114361 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d0d9be35-5cac-4f7d-a8c6-74aeba31d3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:42.115903 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 830/1668] 10.222.0.40 () {58 vars in 1233 bytes} [Sun Jul 31 01:23:41 2022] DELETE /identity/v3/projects/8c2a0ca8c5dc495f97de5c5e8428f23a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:51.756122 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=10,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:52.109560 dv-osbrick-master-4-iscsi devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:00.662883 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:00.664464 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:00.733046 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff853-94c7-433b-aee6-040a6c93d0e2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:00.792312 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f392d45213bd42c38601f9c654350526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c011b2f102644f71ab8895bb88740528', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:00.792939 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:00.793229 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:00.793506 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:00.795374 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:00.806882 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:00.808489 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9bf96-0893-4c19-a52a-1355b184fbf2 service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:00.818563 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 839/1669] 10.222.0.40 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:10.814569 dv-osbrick-master-4-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=58 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}